-- Logs begin at Thu 2022-05-12 16:04:20 UTC, end at Thu 2022-05-12 17:19:40 UTC. -- May 12 16:51:50.594800 dv-osbrick-836060-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... May 12 16:51:50.603011 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 12 16:51:50.606603 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 16:51:50 2022] *** May 12 16:51:50.606603 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 16:51:50.606603 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 16:51:50.606603 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: nodename: dv-osbrick-836060-4-ceph May 12 16:51:50.606603 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: machine: x86_64 May 12 16:51:50.606603 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: clock source: unix May 12 16:51:50.606603 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: pcre jit disabled May 12 16:51:50.606603 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: detected number of CPU cores: 4 May 12 16:51:50.606603 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: current working directory: / May 12 16:51:50.606603 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: detected binary path: /usr/bin/uwsgi-core May 12 16:51:50.606603 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: your processes number limit is 47680 May 12 16:51:50.606603 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: your memory page size is 4096 bytes May 12 16:51:50.606603 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: detected max file descriptor number: 2048 May 12 16:51:50.606603 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: lock engine: pthread robust mutexes May 12 16:51:50.606603 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: thunder lock: enabled May 12 16:51:50.606603 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 12 16:51:50.606603 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 16:51:50.655050 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: Python main interpreter initialized at 0x55a4fa95e9c0 May 12 16:51:50.655050 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: python threads support enabled May 12 16:51:50.655050 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: your server socket listen backlog is limited to 100 connections May 12 16:51:50.655050 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: your mercy for graceful operations on workers is 90 seconds May 12 16:51:50.655423 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: mapped 403077 bytes (393 KB) for 2 cores May 12 16:51:50.655494 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: *** Operational MODE: preforking *** May 12 16:51:50.655762 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: *** uWSGI is running in multiple interpreter mode *** May 12 16:51:50.655762 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: spawned uWSGI master process (pid: 86663) May 12 16:51:50.655971 dv-osbrick-836060-4-ceph systemd[1]: Started Devstack devstack@keystone.service. May 12 16:51:50.656936 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: spawned uWSGI worker 1 (pid: 86673, cores: 1) May 12 16:51:50.656936 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: spawned uWSGI worker 2 (pid: 86674, cores: 1) May 12 16:51:50.657095 dv-osbrick-836060-4-ceph devstack@keystone.service[86663]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 16:51:56.532720 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 16:51:56.532720 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: from cryptography.utils import int_from_bytes May 12 16:51:56.533527 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 16:51:56.533527 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: from cryptography.utils import int_from_bytes May 12 16:51:56.533951 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 16:51:56.533951 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: from cryptography.utils import int_from_bytes May 12 16:51:56.534066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 16:51:56.534066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: from cryptography.utils import int_from_bytes May 12 16:51:56.583441 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 16:51:56.583623 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 16:51:56.583866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] command line args: [] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 16:51:56.584085 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 16:51:56.584252 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ================================================================================ {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 16:51:56.584504 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] admin_token = **** {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.584745 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] config_dir = [] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.584930 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.585116 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] config_source = [] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.585294 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] debug = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.585492 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.587562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.587562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.587562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.587562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.587562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] list_limit = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.587562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] log_config_append = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.587562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.587980 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] log_dir = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.587980 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] log_file = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.588088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.588363 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.588565 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.588758 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.588950 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.589145 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.589371 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.589534 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.589730 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.589957 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.590180 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.590409 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.590653 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.590896 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.591184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.591683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.591916 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] publish_errors = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.592111 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.592280 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.592467 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.592659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 16:51:56.592893 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.593062 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 16:51:56.593062 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] command line args: [] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 16:51:56.593380 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.593380 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] standard_threads = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.593665 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 16:51:56.593665 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ================================================================================ {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 16:51:56.593971 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.594100 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] admin_token = **** {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.594238 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.594238 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.594483 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] config_dir = [] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.594655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] use_journal = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.594792 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.594927 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] use_json = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.595053 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] config_source = [] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.595190 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] use_stderr = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.595323 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] debug = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.595459 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] use_syslog = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.595592 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.595840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.596011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.596142 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.596280 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.596408 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.596546 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.597169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.597303 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.597447 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.597583 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] list_limit = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.597710 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.597837 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] log_config_append = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.597837 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.598075 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.598201 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] log_dir = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.598334 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.598467 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] log_file = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.598628 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.598881 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.599035 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.599236 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.599377 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.600635 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.600830 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.601077 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.601279 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.601499 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.601499 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.601881 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.602076 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.602553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.602773 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.602971 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.603162 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.603364 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.603584 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.603792 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.604037 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.604230 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.604419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.604603 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.604826 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.605026 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.605225 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.605387 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.605545 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.605705 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.605705 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.605965 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.606136 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.606272 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] publish_errors = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.606474 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.606610 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.606851 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.606991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.607118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.607246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.607378 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.607515 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.607709 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.607844 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.607982 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.608153 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] standard_threads = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.608284 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.608421 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.608550 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.608676 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.608803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.608929 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.609061 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.609196 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] use_journal = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.609196 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] use_json = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.609442 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.609570 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] use_stderr = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.609705 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.609832 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] use_syslog = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.609967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.610100 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 16:51:56.610233 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.610365 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.610493 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.610620 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.610788 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.610950 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.611078 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.611205 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.611336 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.611472 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.611621 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.611770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.611906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.612033 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.612159 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.612896 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.613039 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.613039 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.613293 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.613427 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.613554 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.613687 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.613930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.614074 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.614203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.614340 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.614469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.614595 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.614731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.614859 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.614986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.615112 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.615239 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.615372 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.615508 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.615669 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.615803 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.615941 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.616069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.616204 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.616340 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.616537 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.616669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.616796 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.616924 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.617051 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.617051 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.617300 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.617433 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.617569 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.617714 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.617842 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.617978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.618107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.618235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.618361 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.618488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.618620 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.618756 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.618890 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.619018 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.619150 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.619277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.619413 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.619548 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.619736 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.619903 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.620041 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.620169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.620296 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.620431 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.620560 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.620700 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.620829 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.620962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.621099 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.621232 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.621370 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.621497 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.621629 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.621847 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.622017 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.622157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.622296 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.622425 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.622564 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.622692 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.622820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.622946 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.623082 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.623218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.623355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.623483 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.623611 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.623772 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.623912 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.624047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.624176 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.624304 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.624437 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.624565 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.624701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.624830 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.624958 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.625100 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.625230 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.625357 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.625493 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.625621 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.625749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.625876 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.626004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.626131 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.626267 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.626402 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.626533 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.626661 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.626789 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.626926 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.627063 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.627192 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.627320 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.627448 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.627575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.627804 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.627937 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.628065 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.628194 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.628329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.628460 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.628588 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.628734 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.628864 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] auth.external = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.628991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.629118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.629246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.629373 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.629512 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.629652 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.629789 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.629918 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] auth.password = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.630046 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.630173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] auth.token = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.630309 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.630438 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.630438 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.630707 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.630707 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.630949 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.630949 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.631203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.631333 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.631461 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.631589 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.631769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.631906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.632043 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.632172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] credential.caching = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.632310 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.632438 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.632567 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.632695 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.632831 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.632960 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.633088 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.633216 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.633343 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.633471 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.633607 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.633741 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.633869 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.633996 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.634139 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.634268 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.634403 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.634531 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.634814 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.634961 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.635092 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.635092 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.635421 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.635551 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.635735 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.635872 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.636001 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.636140 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.636270 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.636405 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.636544 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.636680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.636816 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] federation.caching = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.636945 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.637073 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.637201 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.637337 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.637467 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.637600 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.637729 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.637867 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.638006 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.638143 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.638275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.638403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.638532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.638659 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.638659 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.638928 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.639058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.639188 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.639316 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.639446 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.639574 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.639734 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] auth.external = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.639876 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] identity.caching = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.640007 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.640136 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.640270 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.640409 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.640540 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.640674 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.640803 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] auth.password = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.640933 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.641063 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] auth.token = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.641200 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.641330 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.641458 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.641596 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.641731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.641860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.641997 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.642127 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.642256 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.642384 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.642513 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.642641 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.642847 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.642979 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.643109 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.643238 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] credential.caching = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.643367 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.643518 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.643693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.643830 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.643966 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.644097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.644226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.644355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.644492 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.644628 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.644803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.644938 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.645067 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.645196 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.645346 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.645478 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.645606 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.645735 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.645863 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.645998 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.646135 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.646266 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.646404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.646404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.646747 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.646910 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.647050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.647181 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.647321 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.647450 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.647579 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.647731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.647871 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] federation.caching = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.648001 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.648138 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.648267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.648396 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.648524 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.648660 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.648789 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.648917 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.649059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.649188 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.649317 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.649454 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.649583 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.649711 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.649839 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.649973 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.650101 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.650237 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.650368 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.650497 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.650625 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.650754 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.650891 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.651029 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] identity.caching = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.651158 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.651287 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.651416 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.651545 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.651744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.651881 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.652010 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.652138 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.652267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.652395 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.652533 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.652673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.652810 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.652939 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.653068 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.653068 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.653318 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.653448 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.user = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.653577 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.653705 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.653834 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.653961 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.654098 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.654227 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.654355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.654493 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.654624 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.654752 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.654888 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.655018 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.655145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.655274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.655402 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.655531 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.655688 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.655824 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.655953 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.656082 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.656219 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.656357 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.656541 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.656675 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.656804 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.656933 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.657061 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.657190 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.657326 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.657456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.657584 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.657713 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.657842 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.657971 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.658117 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.658246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.658375 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.658503 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.658632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.658761 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.658898 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.659027 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.659659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.659801 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.659937 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.660071 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.660217 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.660353 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.660498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.660633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.660768 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.660903 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.661048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.661184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.661319 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.661454 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.661588 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.661722 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.661865 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.662007 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.662007 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.662320 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.662470 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.662605 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.662748 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.662885 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.663020 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.663155 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.663290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.663425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.663568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.663766 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.663903 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] resource.caching = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.664039 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.664174 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.664318 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.664465 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.664601 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.664736 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.664871 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.665005 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.665141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.665283 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.665419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.665554 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.665688 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.user = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.665823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.665957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.666100 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.666246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.666392 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.666527 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.666661 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] role.caching = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.666803 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.666939 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] role.driver = sql {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.667074 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.667210 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.667344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.667344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.667605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.667761 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.667897 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.668033 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.668178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.668314 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.668460 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.668597 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.668732 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.668866 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.669000 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.669134 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.669347 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.669487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.669621 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.669756 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.669891 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.670037 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.670180 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.670318 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.670452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.670588 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.670724 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.670860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.671003 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.671139 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.671139 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.671394 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.671529 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.671681 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.671842 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.671979 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.672115 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.672250 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.672385 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.672520 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.672664 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.672801 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.672936 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.673071 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.673212 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.673348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.673492 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.673628 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.673776 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.673913 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.674048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.674183 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.674326 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.674462 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.674599 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.674733 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.675395 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.675531 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.675708 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.675851 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.675986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.676130 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.676272 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] resource.caching = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.676410 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.676554 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.676692 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.676692 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.676947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.677082 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] token.caching = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.677216 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.677359 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.677496 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.677633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.677773 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.677908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.678060 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.678197 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.678332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.678467 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.678601 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.678737 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.678880 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.679016 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.679151 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] role.caching = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.679286 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.679420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] role.driver = sql {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.679555 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.679721 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.679861 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.680006 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.680142 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.680277 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.680413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.680556 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.680692 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.680828 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.680963 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.681098 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.681233 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.681376 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.681512 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.681647 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.681821 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.681959 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.682094 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] database.connection = **** {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.682242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.682386 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.682531 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.682667 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.682802 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.682940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.683076 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.683219 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.683356 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.683491 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.683491 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.683778 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.683914 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.684061 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.684198 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.684333 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.684469 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.684603 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.684737 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.684881 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.685018 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.685152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.685287 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.685423 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.685567 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.685711 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.685847 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.685983 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.686119 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.686261 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.686401 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.686545 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.686689 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.686825 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.686960 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.686960 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 16:51:56.687225 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.687225 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.687225 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.687225 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.687225 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.687225 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.687225 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.687225 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] token.caching = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.687225 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.688424 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.688424 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.688424 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.688424 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.688424 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.688424 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.688424 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.688424 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.688424 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.689534 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.689534 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.689534 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.689534 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.689534 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.689534 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.689534 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.689534 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] database.connection = **** {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.689534 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.690700 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.690700 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.690700 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.690700 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.690700 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.690700 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.690700 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.690700 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.690700 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.691922 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.691922 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.691922 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.691922 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.691922 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.691922 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.691922 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.691922 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 16:51:56.691922 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86673) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 16:51:56.699550 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.699806 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.700027 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.705487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.705722 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.705967 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.708596 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.714630 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.738129 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.738375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.742503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.742740 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.790518 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.791346 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.841133 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.841431 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.842348 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.842526 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.911106 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.911106 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.911429 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.911429 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.911733 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.911877 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.916195 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.916433 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.916662 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.916886 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.917110 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.917331 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.935200 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.935436 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.935793 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.935969 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.936118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.936279 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.936424 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.936565 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.936707 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.936863 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.937023 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.937166 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.937166 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.937166 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.949597 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.949934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.963202 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.963444 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.963601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.963784 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.963945 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.964106 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.964252 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.964394 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.964536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.964678 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.964828 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.964972 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.965114 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86674) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.965255 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86673) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 16:51:56.982837 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:56.983051 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 16:51:56.983219 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:56.983365 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 16:51:56.983506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:56.983700 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 16:51:56.983851 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:56.984006 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:56.984149 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 16:51:56.984290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:56.984431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:56.984572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:56.984725 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:56.984875 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:56.985020 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:56.985020 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:56.995273 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:56.995545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:56.995744 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:56.995892 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:56.996036 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:56.996177 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:56.996321 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:56.996474 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.004293 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.004691 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.007528 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.007891 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.008104 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.008261 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.008404 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.008546 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.008688 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.008830 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.008991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.009136 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.009287 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.009428 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.009570 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.009712 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.009862 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.010005 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.010148 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.010290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.010431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.010592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.010736 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.010736 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.037443 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.038067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.039033 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.039310 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.039699 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.039981 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.044573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.044808 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.045103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.045256 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.045489 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.045770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.052465 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.052744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.053227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.053517 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.057437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.057722 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.057996 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.058198 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.058344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.058486 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.058628 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.058779 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.058922 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.059064 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.059205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.059349 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.059491 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.059678 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.059678 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.059954 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.077854 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.078127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.078478 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.078755 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.083200 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.083880 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.086822 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.087109 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.087530 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.087848 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.092223 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.092990 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.095820 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.097155 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.100012 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.100302 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.100577 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.100851 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.101120 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.101272 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.101453 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.101602 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.101804 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.102084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.102626 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.102919 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.120839 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.121245 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.121413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.121644 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.122258 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.122568 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.122840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.123104 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.129815 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.131206 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.131520 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.131825 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.132969 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.133253 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.135027 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.135312 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.135586 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.135888 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.136164 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.136530 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.136820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.137106 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.137396 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.137686 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.150223 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.150560 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.150833 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.151142 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.151453 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.151731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.151946 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.152105 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.152255 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.152436 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.152585 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.152833 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.153109 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.153398 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.171188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.173365 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.174524 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.176965 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.177913 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.179484 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.180321 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.181290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.181566 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.181855 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.182023 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.183743 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.184025 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.184325 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.189195 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.191022 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.191772 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.193412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.194501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.194942 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.195353 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.195817 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.196687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.196991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.197279 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.197572 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.208887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.209215 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.209536 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.213741 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.214173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.214575 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.217488 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86673) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.217776 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.218056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.218333 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.218605 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.218893 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.219169 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.219455 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.219862 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.220144 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.220415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.220677 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.220952 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.221232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86673) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.229404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86674) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 16:51:57.229889 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.230362 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.230843 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.231299 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.231843 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.232322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.232798 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.233434 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.233863 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.234240 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.234398 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.234657 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.234943 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86674) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 16:51:57.271088 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a4fa95e9c0 pid: 86673 (default app) May 12 16:51:57.276651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398f263-fc04-45c7-bb89-1e2bc44856b4 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:51:57.277104 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398f263-fc04-45c7-bb89-1e2bc44856b4 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:51:57.277534 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398f263-fc04-45c7-bb89-1e2bc44856b4 None None] PATH_INFO: `/v3` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:51:57.283220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a4fa95e9c0 pid: 86674 (default app) May 12 16:51:57.284612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Thu May 12 16:51:57 2022] GET /identity/v3/ => generated 255 bytes in 13 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:05.504881 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9039bb-4e1e-4a90-a0c0-153049dd0c6f None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:05.505439 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9039bb-4e1e-4a90-a0c0-153049dd0c6f None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:05.505439 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9039bb-4e1e-4a90-a0c0-153049dd0c6f None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:05.509791 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:05.515239 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518091f2-be9e-47d5-a7b2-feb58b112e4e None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:05.515690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518091f2-be9e-47d5-a7b2-feb58b112e4e None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:05.515833 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518091f2-be9e-47d5-a7b2-feb58b112e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:05.547022 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG oslo_db.sqlalchemy.engines [None req-518091f2-be9e-47d5-a7b2-feb58b112e4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86673) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 16:52:05.732814 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG passlib.handlers.bcrypt [None req-518091f2-be9e-47d5-a7b2-feb58b112e4e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86673) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 16:52:05.733249 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG passlib.handlers.bcrypt [None req-518091f2-be9e-47d5-a7b2-feb58b112e4e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86673) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 16:52:05.788366 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-518091f2-be9e-47d5-a7b2-feb58b112e4e None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:05.789893 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-518091f2-be9e-47d5-a7b2-feb58b112e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:05.911294 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 12 16:52:06.055203 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9039bb-4e1e-4a90-a0c0-153049dd0c6f None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:06.088684 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG oslo_db.sqlalchemy.engines [None req-0a9039bb-4e1e-4a90-a0c0-153049dd0c6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 16:52:06.217238 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9039bb-4e1e-4a90-a0c0-153049dd0c6f None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:06.222124 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102db675-0a02-40df-ba26-62e0a55706ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:06.222777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102db675-0a02-40df-ba26-62e0a55706ec admin admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:06.223066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102db675-0a02-40df-ba26-62e0a55706ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:06.223343 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102db675-0a02-40df-ba26-62e0a55706ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:06.231725 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102db675-0a02-40df-ba26-62e0a55706ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:06.283508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: WARNING keystone.common.rbac_enforcer.enforcer [None req-102db675-0a02-40df-ba26-62e0a55706ec admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 16:52:06.283898 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102db675-0a02-40df-ba26-62e0a55706ec admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:06.293423 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Thu May 12 16:52:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 16:52:06.299372 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518091f2-be9e-47d5-a7b2-feb58b112e4e None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:06.313548 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518091f2-be9e-47d5-a7b2-feb58b112e4e None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:06.318383 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605ebe3-51d1-422c-b97a-c1b066960fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:06.319498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605ebe3-51d1-422c-b97a-c1b066960fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:06.319825 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605ebe3-51d1-422c-b97a-c1b066960fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:06.320105 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605ebe3-51d1-422c-b97a-c1b066960fb4 admin admin] PATH_INFO: `/v3/projects/3dca91e00e894d69a0b385cea4a3db66` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:06.321592 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605ebe3-51d1-422c-b97a-c1b066960fb4 admin admin] RBAC: Authorizing `identity:get_project(project_id=3dca91e00e894d69a0b385cea4a3db66)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:06.371928 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e605ebe3-51d1-422c-b97a-c1b066960fb4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 16:52:06.372270 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605ebe3-51d1-422c-b97a-c1b066960fb4 admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:06.378585 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Thu May 12 16:52:06 2022] GET /identity/v3/projects/3dca91e00e894d69a0b385cea4a3db66 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:08.622013 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2223e-89bf-421f-802f-fc62b53db305 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:08.622521 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2223e-89bf-421f-802f-fc62b53db305 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:08.622627 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2223e-89bf-421f-802f-fc62b53db305 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:08.626736 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:08.632348 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01c4aa-45d5-4b97-b644-2efe93a36122 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:08.632734 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01c4aa-45d5-4b97-b644-2efe93a36122 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:08.632916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01c4aa-45d5-4b97-b644-2efe93a36122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:08.759600 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-bf01c4aa-45d5-4b97-b644-2efe93a36122 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:08.761180 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-bf01c4aa-45d5-4b97-b644-2efe93a36122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:08.769101 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 12 16:52:08.792749 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2223e-89bf-421f-802f-fc62b53db305 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:08.805100 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2223e-89bf-421f-802f-fc62b53db305 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:08.809311 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed2da4-c78c-4b6c-abb7-f4e8902475da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:08.809944 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed2da4-c78c-4b6c-abb7-f4e8902475da admin admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:08.810230 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed2da4-c78c-4b6c-abb7-f4e8902475da admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:08.810511 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed2da4-c78c-4b6c-abb7-f4e8902475da admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:08.818079 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed2da4-c78c-4b6c-abb7-f4e8902475da admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:08.819892 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed2da4-c78c-4b6c-abb7-f4e8902475da admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:08.828477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Thu May 12 16:52:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 16:52:08.833585 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01c4aa-45d5-4b97-b644-2efe93a36122 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:08.842375 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01c4aa-45d5-4b97-b644-2efe93a36122 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:08.847296 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4269d1-a766-4d45-8a36-f60ab12e2492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:08.848189 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4269d1-a766-4d45-8a36-f60ab12e2492 admin admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:08.848474 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4269d1-a766-4d45-8a36-f60ab12e2492 admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:08.848752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4269d1-a766-4d45-8a36-f60ab12e2492 admin admin] PATH_INFO: `/v3/users/bbf536e8106349f196ff7b89dc343a4a` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:08.850149 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4269d1-a766-4d45-8a36-f60ab12e2492 admin admin] RBAC: Authorizing `identity:get_user(user_id=bbf536e8106349f196ff7b89dc343a4a)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:08.852267 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4269d1-a766-4d45-8a36-f60ab12e2492 admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:08.853863 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Thu May 12 16:52:08 2022] GET /identity/v3/users/bbf536e8106349f196ff7b89dc343a4a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:11.180005 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb24868-1312-4157-998d-1f51a61a6fbf None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:11.180499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb24868-1312-4157-998d-1f51a61a6fbf None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:11.180499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb24868-1312-4157-998d-1f51a61a6fbf None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:11.181831 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:11.187048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9beae15-8137-4605-9056-6f82ae198dd7 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:11.187469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9beae15-8137-4605-9056-6f82ae198dd7 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:11.187772 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9beae15-8137-4605-9056-6f82ae198dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:11.203950 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-d9beae15-8137-4605-9056-6f82ae198dd7 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:11.205136 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-d9beae15-8137-4605-9056-6f82ae198dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:11.208310 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1704a83-7a60-404e-aa45-104e55be280b None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:11.208660 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1704a83-7a60-404e-aa45-104e55be280b None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:11.209002 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1704a83-7a60-404e-aa45-104e55be280b None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:11.210335 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 6/11] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:52:11.215337 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734eaf8-0eae-497e-9727-ae3b8cb9a155 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:11.215618 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734eaf8-0eae-497e-9727-ae3b8cb9a155 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:11.215924 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734eaf8-0eae-497e-9727-ae3b8cb9a155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:11.254616 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG passlib.handlers.bcrypt [None req-9734eaf8-0eae-497e-9727-ae3b8cb9a155 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86674) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 16:52:11.255030 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG passlib.handlers.bcrypt [None req-9734eaf8-0eae-497e-9727-ae3b8cb9a155 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86674) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 16:52:11.283504 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:11.301896 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-9734eaf8-0eae-497e-9727-ae3b8cb9a155 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:11.303498 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-9734eaf8-0eae-497e-9727-ae3b8cb9a155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:11.307710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9beae15-8137-4605-9056-6f82ae198dd7 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:11.402563 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:52:11.409851 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9beae15-8137-4605-9056-6f82ae198dd7 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:11.426547 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734eaf8-0eae-497e-9727-ae3b8cb9a155 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:11.441722 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fa7e0-1aa9-4c78-a9bf-cb1d47e05c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:11.442455 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fa7e0-1aa9-4c78-a9bf-cb1d47e05c37 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:11.442734 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fa7e0-1aa9-4c78-a9bf-cb1d47e05c37 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:11.443011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fa7e0-1aa9-4c78-a9bf-cb1d47e05c37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:11.453645 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fa7e0-1aa9-4c78-a9bf-cb1d47e05c37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:11.465241 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-cd3fa7e0-1aa9-4c78-a9bf-cb1d47e05c37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:52:11.465241 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:11.465241 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:11.465241 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:11.465241 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:11.465241 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:11.465241 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:11.465241 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:11.465241 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:11.465241 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:11.465241 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:11.465241 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:11.465241 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:11.465241 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:11.465241 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:11.465241 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:11.466126 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:11.466126 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:11.466126 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:11.466126 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:11.466126 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:11.466126 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:11.466126 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:11.466126 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:11.466126 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:11.466126 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:11.466126 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:11.466126 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:52:11.466126 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:11.466126 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:11.466126 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:11.466126 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:11.466924 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:11.466924 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:11.466924 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:11.466924 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:11.466924 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:11.466924 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:11.466924 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:11.466924 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:11.466924 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:11.466924 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:11.466924 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:52:11.466924 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:52:11.466924 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 7/14] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 12 16:52:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:52:11.472757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fa7e0-1aa9-4c78-a9bf-cb1d47e05c37 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:11.522761 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734eaf8-0eae-497e-9727-ae3b8cb9a155 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:11.553816 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ff35c-4cf7-4a08-859b-01cec3507349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:11.554693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ff35c-4cf7-4a08-859b-01cec3507349 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:11.554973 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ff35c-4cf7-4a08-859b-01cec3507349 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:11.555247 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ff35c-4cf7-4a08-859b-01cec3507349 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:11.565269 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fa7e0-1aa9-4c78-a9bf-cb1d47e05c37 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:11.598000 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6921f-ccae-462a-9db1-385887f2c3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:11.598667 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6921f-ccae-462a-9db1-385887f2c3a3 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:11.598957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6921f-ccae-462a-9db1-385887f2c3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:11.599238 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6921f-ccae-462a-9db1-385887f2c3a3 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:11.600017 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6921f-ccae-462a-9db1-385887f2c3a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:11.600325 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6921f-ccae-462a-9db1-385887f2c3a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:11.601733 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6921f-ccae-462a-9db1-385887f2c3a3 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:11.613460 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 8/15] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:52:11.618881 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6921f-ccae-462a-9db1-385887f2c3a3 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:11.620895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ff35c-4cf7-4a08-859b-01cec3507349 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:11.622454 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ff35c-4cf7-4a08-859b-01cec3507349 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:11.715237 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6921f-ccae-462a-9db1-385887f2c3a3 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:11.716072 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 8/16] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:52:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 16:52:11.721646 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ff35c-4cf7-4a08-859b-01cec3507349 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:11.746991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18378680-4e74-4490-a6bd-fce27ea27d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:11.747886 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18378680-4e74-4490-a6bd-fce27ea27d95 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:11.748169 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18378680-4e74-4490-a6bd-fce27ea27d95 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:11.748441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18378680-4e74-4490-a6bd-fce27ea27d95 None admin] PATH_INFO: `/v3/users/bbf536e8106349f196ff7b89dc343a4a` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:11.749632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18378680-4e74-4490-a6bd-fce27ea27d95 None admin] RBAC: Authorizing `identity:get_user(user_id=bbf536e8106349f196ff7b89dc343a4a)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:11.751094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18378680-4e74-4490-a6bd-fce27ea27d95 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:11.753523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 9/17] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:11 2022] GET /identity/v3/users/bbf536e8106349f196ff7b89dc343a4a => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:52:11.758738 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18378680-4e74-4490-a6bd-fce27ea27d95 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:11.857355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18378680-4e74-4490-a6bd-fce27ea27d95 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:11.892822 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549f68c-1f1f-4ca7-86d3-444cfc57435e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:11.893626 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549f68c-1f1f-4ca7-86d3-444cfc57435e None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:11.893912 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549f68c-1f1f-4ca7-86d3-444cfc57435e None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:11.894188 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549f68c-1f1f-4ca7-86d3-444cfc57435e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:11.895399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549f68c-1f1f-4ca7-86d3-444cfc57435e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:11.896919 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549f68c-1f1f-4ca7-86d3-444cfc57435e None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:11.898563 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 10/18] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:52:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:11.904196 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549f68c-1f1f-4ca7-86d3-444cfc57435e None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:11.925823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ff35c-4cf7-4a08-859b-01cec3507349 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:11.957756 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e8977-9da1-4e22-8b3a-2d4892d0b492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:11.958532 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e8977-9da1-4e22-8b3a-2d4892d0b492 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:11.958809 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e8977-9da1-4e22-8b3a-2d4892d0b492 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:11.959079 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e8977-9da1-4e22-8b3a-2d4892d0b492 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:11.976848 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e8977-9da1-4e22-8b3a-2d4892d0b492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:11.978507 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e8977-9da1-4e22-8b3a-2d4892d0b492 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:11.997563 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549f68c-1f1f-4ca7-86d3-444cfc57435e None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:11.998426 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-ea6e8977-9da1-4e22-8b3a-2d4892d0b492 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:52:11.998426 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:11.998426 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:11.998426 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:11.998426 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:11.998426 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:11.998426 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:11.998426 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:11.998426 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:11.998426 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:11.998426 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:11.998426 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:11.998426 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:52:11.998426 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:52:11.998426 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:52:11.999344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:52:11.999344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:11.999344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:11.999344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:11.999344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:11.999344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:11.999344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:11.999344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:11.999344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:52:11.999344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:11.999344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:11.999344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:11.999344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:11.999344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:11.999344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:11.999344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:11.999344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:12.000342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:52:12.000342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:52:12.000342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:52:12.000342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:52:12.000342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 9/19] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:52:12.007005 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e8977-9da1-4e22-8b3a-2d4892d0b492 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:12.030180 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32207d3-1149-4d1f-8c3a-1741aaf513bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:12.030924 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32207d3-1149-4d1f-8c3a-1741aaf513bf None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:12.031210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32207d3-1149-4d1f-8c3a-1741aaf513bf None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:12.031491 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32207d3-1149-4d1f-8c3a-1741aaf513bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:12.032353 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32207d3-1149-4d1f-8c3a-1741aaf513bf None admin] RBAC: Adding query filter params (role.id=fbd6364b42a641f695c0b265a789057a, scope.domain.id=default, user.id=bbf536e8106349f196ff7b89dc343a4a) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:12.032677 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32207d3-1149-4d1f-8c3a-1741aaf513bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:12.034164 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32207d3-1149-4d1f-8c3a-1741aaf513bf None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:12.040679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 11/20] 10.222.0.64 () {56 vars in 1322 bytes} [Thu May 12 16:52:11 2022] GET /identity/v3/role_assignments?user.id=bbf536e8106349f196ff7b89dc343a4a&scope.domain.id=default&role.id=fbd6364b42a641f695c0b265a789057a => generated 233 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:52:12.107181 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e8977-9da1-4e22-8b3a-2d4892d0b492 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:12.142427 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0002e-9331-42bb-8acf-56a6dc84a4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:12.143140 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0002e-9331-42bb-8acf-56a6dc84a4bf None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:12.143425 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0002e-9331-42bb-8acf-56a6dc84a4bf None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:12.143731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0002e-9331-42bb-8acf-56a6dc84a4bf None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:12.144477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0002e-9331-42bb-8acf-56a6dc84a4bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:12.144785 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0002e-9331-42bb-8acf-56a6dc84a4bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:12.146212 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0002e-9331-42bb-8acf-56a6dc84a4bf None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:12.164679 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 10/21] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:52:14.552468 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66cb81-e49c-41d3-bb32-b728e28d5964 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:14.553469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66cb81-e49c-41d3-bb32-b728e28d5964 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:14.553973 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66cb81-e49c-41d3-bb32-b728e28d5964 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:14.555545 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 12/22] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:14.560992 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369af8f-b1f7-4499-91eb-a55e670c3ab9 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:14.561782 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369af8f-b1f7-4499-91eb-a55e670c3ab9 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:14.562250 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369af8f-b1f7-4499-91eb-a55e670c3ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:14.588650 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-2369af8f-b1f7-4499-91eb-a55e670c3ab9 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:14.590152 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-2369af8f-b1f7-4499-91eb-a55e670c3ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:14.665200 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 11/23] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:14.706827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66cb81-e49c-41d3-bb32-b728e28d5964 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:14.836654 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66cb81-e49c-41d3-bb32-b728e28d5964 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:14.879145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e81092-309d-4830-b44a-dd1981bf804d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:14.880336 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e81092-309d-4830-b44a-dd1981bf804d None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:14.880830 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e81092-309d-4830-b44a-dd1981bf804d None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:14.881308 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e81092-309d-4830-b44a-dd1981bf804d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:14.897871 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e81092-309d-4830-b44a-dd1981bf804d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:14.905887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-b8e81092-309d-4830-b44a-dd1981bf804d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:52:14.905887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:14.905887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:14.905887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:14.905887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:14.905887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:14.905887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:14.905887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:14.905887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:14.905887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:14.905887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:14.905887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:14.905887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:14.905887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:14.905887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:14.905887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:14.906687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:14.906687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:14.906687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:14.906687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:14.906687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:14.906687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:14.906687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:14.906687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:14.906687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:14.906687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:14.906687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:14.906687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:52:14.906687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:14.906687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:14.906687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:14.906687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:14.907436 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:14.907436 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:14.907436 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:14.907436 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:14.907436 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:14.907436 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:14.907436 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:14.907436 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:14.907436 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:14.907436 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:14.907436 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:52:14.907436 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:52:14.914433 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 13/24] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 12 16:52:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:14.921255 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369af8f-b1f7-4499-91eb-a55e670c3ab9 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:15.078242 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369af8f-b1f7-4499-91eb-a55e670c3ab9 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:15.125544 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65f059-4f10-451e-acd8-b1a50a40d48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:15.126154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65f059-4f10-451e-acd8-b1a50a40d48a None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:15.126437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65f059-4f10-451e-acd8-b1a50a40d48a None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:15.126717 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65f059-4f10-451e-acd8-b1a50a40d48a None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:15.127542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65f059-4f10-451e-acd8-b1a50a40d48a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:15.127883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65f059-4f10-451e-acd8-b1a50a40d48a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:15.129339 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65f059-4f10-451e-acd8-b1a50a40d48a None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:15.148704 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 12/25] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:15.154700 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e81092-309d-4830-b44a-dd1981bf804d None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:15.269162 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e81092-309d-4830-b44a-dd1981bf804d None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:15.308344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd53334-fe31-4a03-ae96-50e73f55027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:15.309682 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd53334-fe31-4a03-ae96-50e73f55027d None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:15.310158 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd53334-fe31-4a03-ae96-50e73f55027d None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:15.310641 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd53334-fe31-4a03-ae96-50e73f55027d None admin] PATH_INFO: `/v3/users/bbf536e8106349f196ff7b89dc343a4a` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:15.312232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd53334-fe31-4a03-ae96-50e73f55027d None admin] RBAC: Authorizing `identity:get_user(user_id=bbf536e8106349f196ff7b89dc343a4a)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:15.314019 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd53334-fe31-4a03-ae96-50e73f55027d None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:15.316616 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 14/26] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:15 2022] GET /identity/v3/users/bbf536e8106349f196ff7b89dc343a4a => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:15.322626 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65f059-4f10-451e-acd8-b1a50a40d48a None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:15.414504 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab583885-7ffe-442e-890a-06612ee4d47e None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:15.415124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab583885-7ffe-442e-890a-06612ee4d47e None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:15.415608 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab583885-7ffe-442e-890a-06612ee4d47e None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:15.417192 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 15/27] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:52:15.427390 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d73f7-6194-4919-943b-451086f4cf41 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:15.427976 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d73f7-6194-4919-943b-451086f4cf41 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:15.428503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d73f7-6194-4919-943b-451086f4cf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:15.454004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-9e1d73f7-6194-4919-943b-451086f4cf41 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:15.456267 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-9e1d73f7-6194-4919-943b-451086f4cf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:15.485025 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65f059-4f10-451e-acd8-b1a50a40d48a None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:15.548081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e7137-4cdd-419f-b78f-7fd3be8bc9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:15.548974 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e7137-4cdd-419f-b78f-7fd3be8bc9c1 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:15.549287 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e7137-4cdd-419f-b78f-7fd3be8bc9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:15.549560 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e7137-4cdd-419f-b78f-7fd3be8bc9c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:15.551131 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e7137-4cdd-419f-b78f-7fd3be8bc9c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:15.552732 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e7137-4cdd-419f-b78f-7fd3be8bc9c1 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:15.554354 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 13/28] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:52:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:15.555588 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b5601-bd3e-4412-8465-44380367b74d None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:15.555903 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b5601-bd3e-4412-8465-44380367b74d None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:15.556182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b5601-bd3e-4412-8465-44380367b74d None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:15.557414 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 14/29] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:15.562413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b5601-bd3e-4412-8465-44380367b74d None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:15.566316 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 16/30] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:52:15.568045 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299af06f-e175-47ac-acff-40dd0581ad6e None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:15.568474 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299af06f-e175-47ac-acff-40dd0581ad6e None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:15.568848 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299af06f-e175-47ac-acff-40dd0581ad6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:15.604947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-299af06f-e175-47ac-acff-40dd0581ad6e None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:15.606144 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-299af06f-e175-47ac-acff-40dd0581ad6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:15.722570 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 17/31] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:15.723350 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299af06f-e175-47ac-acff-40dd0581ad6e None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:15.738751 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b5601-bd3e-4412-8465-44380367b74d None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:15.802952 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64434227-bfe4-45df-8355-7aaef1fd2592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:15.803868 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64434227-bfe4-45df-8355-7aaef1fd2592 None admin] REQUEST_METHOD: `PUT` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:15.804153 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64434227-bfe4-45df-8355-7aaef1fd2592 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:15.804432 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64434227-bfe4-45df-8355-7aaef1fd2592 None admin] PATH_INFO: `/v3/domains/default/users/bbf536e8106349f196ff7b89dc343a4a/roles/fbd6364b42a641f695c0b265a789057a` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:15.806736 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64434227-bfe4-45df-8355-7aaef1fd2592 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bbf536e8106349f196ff7b89dc343a4a, role_id=fbd6364b42a641f695c0b265a789057a)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:15.808391 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64434227-bfe4-45df-8355-7aaef1fd2592 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:15.864574 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299af06f-e175-47ac-acff-40dd0581ad6e None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:15.906164 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260995a-fac0-4513-ac8b-57efebd14d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:15.906854 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260995a-fac0-4513-ac8b-57efebd14d20 None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:15.907135 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260995a-fac0-4513-ac8b-57efebd14d20 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:15.907411 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260995a-fac0-4513-ac8b-57efebd14d20 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:15.908270 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260995a-fac0-4513-ac8b-57efebd14d20 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:15.910094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260995a-fac0-4513-ac8b-57efebd14d20 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:15.952836 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 15/32] 10.222.0.64 () {58 vars in 1361 bytes} [Thu May 12 16:52:15 2022] PUT /identity/v3/domains/default/users/bbf536e8106349f196ff7b89dc343a4a/roles/fbd6364b42a641f695c0b265a789057a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:52:15.954703 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f775ae-142e-43c0-9968-a1ef8c4ee251 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:15.954995 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f775ae-142e-43c0-9968-a1ef8c4ee251 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:15.955316 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f775ae-142e-43c0-9968-a1ef8c4ee251 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:15.964568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:15.965332 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f775ae-142e-43c0-9968-a1ef8c4ee251 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:16.066928 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 18/34] 10.222.0.64 () {60 vars in 1131 bytes} [Thu May 12 16:52:15 2022] POST /identity/v3/roles => generated 225 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:52:16.068628 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561d804-c060-48b0-a076-ccd0b65b5c7b None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:16.068922 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561d804-c060-48b0-a076-ccd0b65b5c7b None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:16.069204 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561d804-c060-48b0-a076-ccd0b65b5c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:16.089091 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f775ae-142e-43c0-9968-a1ef8c4ee251 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:16.096959 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-e561d804-c060-48b0-a076-ccd0b65b5c7b None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:16.103323 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-e561d804-c060-48b0-a076-ccd0b65b5c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:16.188795 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcec362-9f2a-4221-9a20-c54408103a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:16.189548 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcec362-9f2a-4221-9a20-c54408103a78 None admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:16.189837 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcec362-9f2a-4221-9a20-c54408103a78 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:16.190118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcec362-9f2a-4221-9a20-c54408103a78 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:16.190910 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcec362-9f2a-4221-9a20-c54408103a78 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:16.192562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcec362-9f2a-4221-9a20-c54408103a78 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:16.223903 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 17/35] 10.222.0.64 () {60 vars in 1131 bytes} [Thu May 12 16:52:15 2022] POST /identity/v3/roles => generated 219 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:52:16.225477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861a60e-7134-40d8-aa8c-537d29b7cfd6 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:16.225778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861a60e-7134-40d8-aa8c-537d29b7cfd6 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:16.226065 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861a60e-7134-40d8-aa8c-537d29b7cfd6 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:16.227909 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 18/36] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:16.234143 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95eed23-591b-4c5d-9d60-5592e3083066 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:16.234482 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95eed23-591b-4c5d-9d60-5592e3083066 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:16.234772 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95eed23-591b-4c5d-9d60-5592e3083066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:16.250833 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 19/37] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:16.258114 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-e95eed23-591b-4c5d-9d60-5592e3083066 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:16.260112 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-e95eed23-591b-4c5d-9d60-5592e3083066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:16.321940 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561d804-c060-48b0-a076-ccd0b65b5c7b None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:16.380731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 19/38] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:52:16.442866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95eed23-591b-4c5d-9d60-5592e3083066 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:16.489595 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561d804-c060-48b0-a076-ccd0b65b5c7b None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:16.537962 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5caa7a-f339-438a-ba10-3f559cc66f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:16.538872 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5caa7a-f339-438a-ba10-3f559cc66f74 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:16.539222 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5caa7a-f339-438a-ba10-3f559cc66f74 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:16.539569 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5caa7a-f339-438a-ba10-3f559cc66f74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:16.555457 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5caa7a-f339-438a-ba10-3f559cc66f74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:16.557271 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5caa7a-f339-438a-ba10-3f559cc66f74 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:16.577515 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95eed23-591b-4c5d-9d60-5592e3083066 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:16.578548 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-2b5caa7a-f339-438a-ba10-3f559cc66f74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:52:16.578548 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:16.578548 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:16.578548 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:16.578548 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:16.578548 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:16.578548 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:16.578548 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:16.578548 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:16.578548 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:16.578548 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:16.578548 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:16.578548 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:52:16.578548 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:52:16.578548 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:52:16.579538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:52:16.579538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:16.579538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:16.579538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:16.579538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:16.579538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:16.579538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:16.579538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:16.579538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:52:16.579538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:16.579538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:16.579538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:16.579538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:16.579538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:16.579538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:16.579538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:16.579538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:16.580391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:52:16.580391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:52:16.580391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:52:16.580391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:52:16.582752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 20/39] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:52:16.590124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5caa7a-f339-438a-ba10-3f559cc66f74 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:16.617385 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d9c36-9f92-4ac8-b4a0-926fb3e742d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:16.618268 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d9c36-9f92-4ac8-b4a0-926fb3e742d2 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:16.618654 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d9c36-9f92-4ac8-b4a0-926fb3e742d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:16.618958 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d9c36-9f92-4ac8-b4a0-926fb3e742d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:16.620219 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d9c36-9f92-4ac8-b4a0-926fb3e742d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:16.621761 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d9c36-9f92-4ac8-b4a0-926fb3e742d2 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:16.627657 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 20/40] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:52:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:52:16.633067 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d9c36-9f92-4ac8-b4a0-926fb3e742d2 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:16.703376 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5caa7a-f339-438a-ba10-3f559cc66f74 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:16.739944 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e762a8-8323-42fb-9899-62094668b881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:16.741023 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e762a8-8323-42fb-9899-62094668b881 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:16.741499 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e762a8-8323-42fb-9899-62094668b881 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:16.741670 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d9c36-9f92-4ac8-b4a0-926fb3e742d2 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:16.742134 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e762a8-8323-42fb-9899-62094668b881 None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:16.743057 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e762a8-8323-42fb-9899-62094668b881 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:16.743605 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e762a8-8323-42fb-9899-62094668b881 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:16.745225 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e762a8-8323-42fb-9899-62094668b881 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:16.764320 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 21/41] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:52:16.771990 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e762a8-8323-42fb-9899-62094668b881 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:16.782965 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1efc3-8827-46e2-a3d5-dcd749172762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:16.784328 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1efc3-8827-46e2-a3d5-dcd749172762 None admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:16.784618 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1efc3-8827-46e2-a3d5-dcd749172762 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:16.784909 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1efc3-8827-46e2-a3d5-dcd749172762 None admin] PATH_INFO: `/v3/projects` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:16.785675 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1efc3-8827-46e2-a3d5-dcd749172762 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:16.787220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1efc3-8827-46e2-a3d5-dcd749172762 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:16.827742 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 21/42] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 12 16:52:16 2022] POST /identity/v3/projects => generated 312 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:52:16.882585 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f4bcc-eed0-4e2b-a39e-87882604688d None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:16.882902 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f4bcc-eed0-4e2b-a39e-87882604688d None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:16.883157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f4bcc-eed0-4e2b-a39e-87882604688d None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:16.884751 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 22/43] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:16.890201 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c721916-1f4a-4b1b-85a0-32d820e3b99b None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:16.890489 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c721916-1f4a-4b1b-85a0-32d820e3b99b None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:16.890783 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c721916-1f4a-4b1b-85a0-32d820e3b99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:16.893563 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e762a8-8323-42fb-9899-62094668b881 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:16.909366 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-1c721916-1f4a-4b1b-85a0-32d820e3b99b None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:16.910699 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-1c721916-1f4a-4b1b-85a0-32d820e3b99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:16.935001 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a6d08-d2e2-4432-b9fe-3b7bbeb773f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:16.936064 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a6d08-d2e2-4432-b9fe-3b7bbeb773f1 None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:16.936526 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a6d08-d2e2-4432-b9fe-3b7bbeb773f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:16.936964 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a6d08-d2e2-4432-b9fe-3b7bbeb773f1 None admin] PATH_INFO: `/v3/projects` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:16.937831 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a6d08-d2e2-4432-b9fe-3b7bbeb773f1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:16.939550 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a6d08-d2e2-4432-b9fe-3b7bbeb773f1 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:16.973053 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 22/44] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 12 16:52:16 2022] POST /identity/v3/projects => generated 301 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:52:16.995724 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 23/45] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:52:17.020777 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a6d08-d2e2-4432-b9fe-3b7bbeb773f1 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:17.132014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a6d08-d2e2-4432-b9fe-3b7bbeb773f1 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:17.168761 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d9ac4-999e-4b83-9b17-8e08d20f7dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:17.169446 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d9ac4-999e-4b83-9b17-8e08d20f7dde None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:17.169725 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d9ac4-999e-4b83-9b17-8e08d20f7dde None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:17.170000 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d9ac4-999e-4b83-9b17-8e08d20f7dde None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:17.170750 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d9ac4-999e-4b83-9b17-8e08d20f7dde None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:17.172895 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d9ac4-999e-4b83-9b17-8e08d20f7dde None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:17.187834 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 23/46] 10.222.0.64 () {60 vars in 1131 bytes} [Thu May 12 16:52:17 2022] POST /identity/v3/roles => generated 223 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:52:18.508182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c973dd-0038-4f4f-a439-f83f96334054 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:18.508692 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c973dd-0038-4f4f-a439-f83f96334054 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:18.508774 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c973dd-0038-4f4f-a439-f83f96334054 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:18.510151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 24/47] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:18.515343 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700383e-2d8c-4adf-ab12-820728092370 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:18.515796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700383e-2d8c-4adf-ab12-820728092370 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:18.515955 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700383e-2d8c-4adf-ab12-820728092370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:18.532194 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-0700383e-2d8c-4adf-ab12-820728092370 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:18.534060 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-0700383e-2d8c-4adf-ab12-820728092370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:18.597362 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 24/48] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:18.621410 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c973dd-0038-4f4f-a439-f83f96334054 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:18.726731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c973dd-0038-4f4f-a439-f83f96334054 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:18.758827 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d128085-5f01-40b1-b1f1-b4875fb624f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:18.759532 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d128085-5f01-40b1-b1f1-b4875fb624f2 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:18.759842 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d128085-5f01-40b1-b1f1-b4875fb624f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:18.760117 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d128085-5f01-40b1-b1f1-b4875fb624f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:18.771359 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d128085-5f01-40b1-b1f1-b4875fb624f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:18.780305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-8d128085-5f01-40b1-b1f1-b4875fb624f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:52:18.780305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:18.780305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:18.780305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:18.780305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:18.780305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:18.780305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:18.780305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:18.780305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:18.780305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:18.780305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:18.780305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:18.780305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:18.780305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:18.780305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:18.780305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:18.781154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:18.781154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:18.781154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:18.781154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:18.781154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:18.781154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:18.781154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:18.781154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:18.781154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:18.781154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:18.781154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:18.781154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:52:18.781154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:18.781154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:18.781154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:18.781154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:18.781888 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:18.781888 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:18.781888 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:18.781888 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:18.781888 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:18.781888 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:18.781888 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:18.781888 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:18.781888 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:18.781888 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:18.781888 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:52:18.781888 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:52:18.781888 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 25/49] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 12 16:52:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:18.789310 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700383e-2d8c-4adf-ab12-820728092370 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:18.882002 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700383e-2d8c-4adf-ab12-820728092370 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:18.916837 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b55ba-1704-4eb6-a6cf-0b157c198de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:18.917513 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b55ba-1704-4eb6-a6cf-0b157c198de9 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:18.917799 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b55ba-1704-4eb6-a6cf-0b157c198de9 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:18.918074 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b55ba-1704-4eb6-a6cf-0b157c198de9 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:18.918823 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b55ba-1704-4eb6-a6cf-0b157c198de9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:18.919131 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b55ba-1704-4eb6-a6cf-0b157c198de9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:18.920539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b55ba-1704-4eb6-a6cf-0b157c198de9 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:18.928596 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 25/50] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:18.934068 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d128085-5f01-40b1-b1f1-b4875fb624f2 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:19.034134 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d128085-5f01-40b1-b1f1-b4875fb624f2 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:19.069730 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea40637-6d7f-4247-8061-3e6c583c78b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:19.070620 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea40637-6d7f-4247-8061-3e6c583c78b1 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:19.070900 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea40637-6d7f-4247-8061-3e6c583c78b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:19.071178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea40637-6d7f-4247-8061-3e6c583c78b1 None admin] PATH_INFO: `/v3/users/bbf536e8106349f196ff7b89dc343a4a` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:19.072398 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea40637-6d7f-4247-8061-3e6c583c78b1 None admin] RBAC: Authorizing `identity:get_user(user_id=bbf536e8106349f196ff7b89dc343a4a)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:19.073891 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea40637-6d7f-4247-8061-3e6c583c78b1 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:19.075526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 26/51] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:18 2022] GET /identity/v3/users/bbf536e8106349f196ff7b89dc343a4a => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:19.081537 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b55ba-1704-4eb6-a6cf-0b157c198de9 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:19.178602 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b55ba-1704-4eb6-a6cf-0b157c198de9 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:19.210757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fb917-6569-4eb9-babd-c58658ad773f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:19.211314 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31473a99-53b5-4032-87bb-38103dc188dc None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:19.211615 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31473a99-53b5-4032-87bb-38103dc188dc None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:19.211735 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fb917-6569-4eb9-babd-c58658ad773f None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:19.211937 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31473a99-53b5-4032-87bb-38103dc188dc None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:19.212033 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fb917-6569-4eb9-babd-c58658ad773f None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:19.212276 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fb917-6569-4eb9-babd-c58658ad773f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:19.213309 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 27/52] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:52:19.213493 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fb917-6569-4eb9-babd-c58658ad773f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:19.215007 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fb917-6569-4eb9-babd-c58658ad773f None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:19.216647 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:52:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:52:19.219190 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218e38c-0bc8-4bc5-a2f0-743adf8e5665 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:19.219190 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218e38c-0bc8-4bc5-a2f0-743adf8e5665 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:19.219190 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218e38c-0bc8-4bc5-a2f0-743adf8e5665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:19.222130 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fb917-6569-4eb9-babd-c58658ad773f None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:19.235191 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-3218e38c-0bc8-4bc5-a2f0-743adf8e5665 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:19.236465 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-3218e38c-0bc8-4bc5-a2f0-743adf8e5665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:19.299205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 28/54] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:19.313881 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fb917-6569-4eb9-babd-c58658ad773f None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:19.323356 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218e38c-0bc8-4bc5-a2f0-743adf8e5665 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:19.345748 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da7c86-c3f2-457e-8c57-864e6a36eb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:19.346400 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da7c86-c3f2-457e-8c57-864e6a36eb46 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:19.346685 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da7c86-c3f2-457e-8c57-864e6a36eb46 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:19.346964 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da7c86-c3f2-457e-8c57-864e6a36eb46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:19.347815 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da7c86-c3f2-457e-8c57-864e6a36eb46 None admin] RBAC: Adding query filter params (role.id=fbd6364b42a641f695c0b265a789057a, scope.domain.id=default, user.id=bbf536e8106349f196ff7b89dc343a4a) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:19.348125 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da7c86-c3f2-457e-8c57-864e6a36eb46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:19.349553 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27da7c86-c3f2-457e-8c57-864e6a36eb46 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:19.355368 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1322 bytes} [Thu May 12 16:52:19 2022] GET /identity/v3/role_assignments?user.id=bbf536e8106349f196ff7b89dc343a4a&scope.domain.id=default&role.id=fbd6364b42a641f695c0b265a789057a => generated 530 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:52:19.438237 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218e38c-0bc8-4bc5-a2f0-743adf8e5665 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:19.482232 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8825e9-600e-4b6b-88c0-bfa9147f039f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:19.483042 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8825e9-600e-4b6b-88c0-bfa9147f039f None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:19.483327 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8825e9-600e-4b6b-88c0-bfa9147f039f None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:19.483607 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8825e9-600e-4b6b-88c0-bfa9147f039f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:19.484890 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8825e9-600e-4b6b-88c0-bfa9147f039f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:19.486920 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8825e9-600e-4b6b-88c0-bfa9147f039f None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:19.488651 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 29/56] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:52:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:52:19.494485 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da7c86-c3f2-457e-8c57-864e6a36eb46 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:19.593886 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da7c86-c3f2-457e-8c57-864e6a36eb46 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:19.625731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1e43e-d6ba-4e8e-8559-33df9f9c8dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:19.626396 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1e43e-d6ba-4e8e-8559-33df9f9c8dd9 None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:19.626680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1e43e-d6ba-4e8e-8559-33df9f9c8dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:19.627567 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1e43e-d6ba-4e8e-8559-33df9f9c8dd9 None admin] PATH_INFO: `/v3/projects` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:19.628304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1e43e-d6ba-4e8e-8559-33df9f9c8dd9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:19.629763 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1e43e-d6ba-4e8e-8559-33df9f9c8dd9 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:19.653005 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 28/57] 10.222.0.64 () {60 vars in 1140 bytes} [Thu May 12 16:52:19 2022] POST /identity/v3/projects => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:52:21.942376 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885d1a3-a63b-451e-ba97-2b2840a87710 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:21.942891 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885d1a3-a63b-451e-ba97-2b2840a87710 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:21.942980 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885d1a3-a63b-451e-ba97-2b2840a87710 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:21.944341 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 30/58] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:21.949489 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64857f55-bc06-4354-bfd2-7cd34ac1cb2f None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:21.949925 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64857f55-bc06-4354-bfd2-7cd34ac1cb2f None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:21.950058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64857f55-bc06-4354-bfd2-7cd34ac1cb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:21.966580 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-64857f55-bc06-4354-bfd2-7cd34ac1cb2f None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:21.967879 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-64857f55-bc06-4354-bfd2-7cd34ac1cb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:22.031751 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 29/59] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:22.056365 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885d1a3-a63b-451e-ba97-2b2840a87710 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:22.153943 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885d1a3-a63b-451e-ba97-2b2840a87710 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:22.185641 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffbfae-ec7f-4df2-aecf-917d619f4729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:22.186356 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffbfae-ec7f-4df2-aecf-917d619f4729 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:22.186640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffbfae-ec7f-4df2-aecf-917d619f4729 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:22.186918 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffbfae-ec7f-4df2-aecf-917d619f4729 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:22.188118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffbfae-ec7f-4df2-aecf-917d619f4729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:22.190111 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffbfae-ec7f-4df2-aecf-917d619f4729 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:22.191720 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 31/60] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:52:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:22.196975 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64857f55-bc06-4354-bfd2-7cd34ac1cb2f None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:22.288402 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64857f55-bc06-4354-bfd2-7cd34ac1cb2f None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:22.319513 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32487cff-ebda-4ebe-8324-661486c3f894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:22.320197 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487cff-ebda-4ebe-8324-661486c3f894 None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:22.320479 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487cff-ebda-4ebe-8324-661486c3f894 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:22.320755 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487cff-ebda-4ebe-8324-661486c3f894 None admin] PATH_INFO: `/v3/users` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:22.321457 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32487cff-ebda-4ebe-8324-661486c3f894 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:22.322903 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32487cff-ebda-4ebe-8324-661486c3f894 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:22.347574 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 30/61] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 12 16:52:22 2022] POST /identity/v3/users => generated 275 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:52:25.810512 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87008505-6733-46b3-8d1b-74e0c1d9f19e None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:25.811398 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87008505-6733-46b3-8d1b-74e0c1d9f19e None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:25.811868 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87008505-6733-46b3-8d1b-74e0c1d9f19e None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:25.813721 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 32/62] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:25.825731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938846a-a705-426f-9c3c-01cf2a7d61a3 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:25.826573 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938846a-a705-426f-9c3c-01cf2a7d61a3 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:25.827024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938846a-a705-426f-9c3c-01cf2a7d61a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:25.851719 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-9938846a-a705-426f-9c3c-01cf2a7d61a3 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:25.853408 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-9938846a-a705-426f-9c3c-01cf2a7d61a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:25.945992 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 31/63] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:25.982813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87008505-6733-46b3-8d1b-74e0c1d9f19e None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:25.988318 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8ab9a-df2d-422c-a1ca-f3b518dcfa0f None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:25.988613 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8ab9a-df2d-422c-a1ca-f3b518dcfa0f None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:25.988900 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8ab9a-df2d-422c-a1ca-f3b518dcfa0f None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:25.990567 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 32/64] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:52:25.995856 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de3767-3574-4a0c-b840-2dccf582bb74 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:25.996149 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de3767-3574-4a0c-b840-2dccf582bb74 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:25.996432 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de3767-3574-4a0c-b840-2dccf582bb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:26.038267 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-e0de3767-3574-4a0c-b840-2dccf582bb74 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:26.039472 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-e0de3767-3574-4a0c-b840-2dccf582bb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:26.109116 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87008505-6733-46b3-8d1b-74e0c1d9f19e None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:26.144134 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc1749-a319-49e7-ac7f-d7198954d49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:26.145165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc1749-a319-49e7-ac7f-d7198954d49e None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:26.145591 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc1749-a319-49e7-ac7f-d7198954d49e None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:26.146004 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc1749-a319-49e7-ac7f-d7198954d49e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:26.149778 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 33/65] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:26.151619 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6db79-b4e9-4387-b082-c4c6d5994340 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:26.152137 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6db79-b4e9-4387-b082-c4c6d5994340 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:26.152607 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6db79-b4e9-4387-b082-c4c6d5994340 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:26.154556 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 34/66] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:26.163664 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc1749-a319-49e7-ac7f-d7198954d49e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:26.163801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5f9ef-6d45-42ee-815d-8c709743cde3 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:26.163801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5f9ef-6d45-42ee-815d-8c709743cde3 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:26.163801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5f9ef-6d45-42ee-815d-8c709743cde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:26.167506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-3abc1749-a319-49e7-ac7f-d7198954d49e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:26.167506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:26.167506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:26.167506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:26.167506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:26.167506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:26.167506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:26.167506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:26.167506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:26.167506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:26.167506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:26.167506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:26.167506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:26.167506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:26.167506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:26.167506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:26.168587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:26.168587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:26.168587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:26.168587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:26.168587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:26.168587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:26.168587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:26.168587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:26.168587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:26.168587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:26.168587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:26.168587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:52:26.168587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:26.168587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:26.168587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:26.168587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:26.169462 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:26.169462 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:26.169462 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:26.169462 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:26.169462 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:26.169462 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:26.169462 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:26.169462 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:26.169462 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:26.169462 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:26.169462 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:26.169462 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:52:26.171504 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 33/67] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:26.177986 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc1749-a319-49e7-ac7f-d7198954d49e None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:26.188562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-e5e5f9ef-6d45-42ee-815d-8c709743cde3 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:26.190508 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-e5e5f9ef-6d45-42ee-815d-8c709743cde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:26.261364 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 35/68] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:26.262054 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5f9ef-6d45-42ee-815d-8c709743cde3 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:26.292769 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc1749-a319-49e7-ac7f-d7198954d49e None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:26.327101 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9e349-ad9c-4990-857f-fb47eb707a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:26.327801 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9e349-ad9c-4990-857f-fb47eb707a42 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:26.328084 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9e349-ad9c-4990-857f-fb47eb707a42 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:26.328362 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9e349-ad9c-4990-857f-fb47eb707a42 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:26.329104 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9e349-ad9c-4990-857f-fb47eb707a42 None admin] RBAC: Adding query filter params (name=member) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:26.329409 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9e349-ad9c-4990-857f-fb47eb707a42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:26.330871 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9e349-ad9c-4990-857f-fb47eb707a42 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:26.347701 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 34/69] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:52:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:26.347701 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a32d63-14c4-4a8f-a85a-f1d9275934f2 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:26.347701 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a32d63-14c4-4a8f-a85a-f1d9275934f2 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:26.347701 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a32d63-14c4-4a8f-a85a-f1d9275934f2 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:26.347701 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 35/70] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:26.347701 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a32d63-14c4-4a8f-a85a-f1d9275934f2 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:26.380625 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5f9ef-6d45-42ee-815d-8c709743cde3 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:26.415386 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcb4dd-a244-49b6-b618-4029db6656a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:26.416230 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcb4dd-a244-49b6-b618-4029db6656a0 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:26.416517 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcb4dd-a244-49b6-b618-4029db6656a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:26.416953 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcb4dd-a244-49b6-b618-4029db6656a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:26.432569 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcb4dd-a244-49b6-b618-4029db6656a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:26.440963 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-a5bcb4dd-a244-49b6-b618-4029db6656a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:52:26.440963 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:26.440963 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:26.440963 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:26.440963 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:26.440963 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:26.440963 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:26.440963 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:26.440963 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:26.440963 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:26.440963 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:26.440963 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:26.440963 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:26.440963 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:26.440963 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:26.440963 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:26.441757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:26.441757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:26.441757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:26.441757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:26.441757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:26.441757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:26.441757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:26.441757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:26.441757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:26.441757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:26.441757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:26.441757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:52:26.441757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:26.441757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:26.441757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:26.441757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:26.442502 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:26.442502 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:26.442502 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:26.442502 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:26.442502 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:26.442502 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:26.442502 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:26.442502 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:26.442502 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:26.442502 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:26.442502 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:52:26.442502 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:52:26.442502 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 36/71] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 12 16:52:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:26.443093 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcb4dd-a244-49b6-b618-4029db6656a0 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:26.458060 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a32d63-14c4-4a8f-a85a-f1d9275934f2 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:26.491607 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf0258-d2ff-4c37-99ed-df56ade1cba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:26.492742 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf0258-d2ff-4c37-99ed-df56ade1cba1 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:26.493194 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf0258-d2ff-4c37-99ed-df56ade1cba1 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:26.493642 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf0258-d2ff-4c37-99ed-df56ade1cba1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:26.504014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf0258-d2ff-4c37-99ed-df56ade1cba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:26.514220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-5eaf0258-d2ff-4c37-99ed-df56ade1cba1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:52:26.514220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:26.514220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:26.514220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:26.514220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:26.514220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:26.514220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:26.514220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:26.514220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:26.514220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:26.514220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:26.514220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:26.514220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:26.514220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:26.514220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:26.514220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:26.515041 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:26.515041 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:26.515041 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:26.515041 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:26.515041 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:26.515041 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:26.515041 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:26.515041 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:26.515041 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:26.515041 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:26.515041 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:26.515041 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:52:26.515041 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:26.515041 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:26.515041 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:26.515041 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:26.515882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:26.515882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:26.515882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:26.515882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:26.515882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:26.515882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:26.515882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:26.515882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:26.515882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:26.515882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:26.515882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:52:26.515882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:52:26.517280 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 36/72] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:52:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:26.518274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd697b-ad8f-4db0-8d27-788dd9958078 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:26.518560 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd697b-ad8f-4db0-8d27-788dd9958078 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:26.518839 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd697b-ad8f-4db0-8d27-788dd9958078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:26.535917 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-c1bd697b-ad8f-4db0-8d27-788dd9958078 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:26.537281 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-c1bd697b-ad8f-4db0-8d27-788dd9958078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:26.545988 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcb4dd-a244-49b6-b618-4029db6656a0 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:26.577642 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc18d16-923b-488c-8643-103b40908c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:26.578503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc18d16-923b-488c-8643-103b40908c00 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:26.578782 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc18d16-923b-488c-8643-103b40908c00 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:26.579056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc18d16-923b-488c-8643-103b40908c00 None admin] PATH_INFO: `/v3/users/3e0ac53f471746699df5c834e91784f1` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:26.591415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc18d16-923b-488c-8643-103b40908c00 None admin] RBAC: Authorizing `identity:get_user(user_id=3e0ac53f471746699df5c834e91784f1)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:26.592957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc18d16-923b-488c-8643-103b40908c00 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:26.594589 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 37/73] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:26 2022] GET /identity/v3/users/3e0ac53f471746699df5c834e91784f1 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:26.595902 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc18d16-923b-488c-8643-103b40908c00 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:26.600818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 37/74] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:26.601658 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd697b-ad8f-4db0-8d27-788dd9958078 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:26.689700 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc18d16-923b-488c-8643-103b40908c00 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:26.693025 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd697b-ad8f-4db0-8d27-788dd9958078 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:26.721368 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081abc8-a0a9-411f-abf3-a50e3677c880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:26.722027 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081abc8-a0a9-411f-abf3-a50e3677c880 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:26.722311 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081abc8-a0a9-411f-abf3-a50e3677c880 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:26.722587 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081abc8-a0a9-411f-abf3-a50e3677c880 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:26.723330 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081abc8-a0a9-411f-abf3-a50e3677c880 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:26.723660 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081abc8-a0a9-411f-abf3-a50e3677c880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:26.724518 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499e36b-b3a8-440b-9cdb-7d1cf614a138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:26.725044 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081abc8-a0a9-411f-abf3-a50e3677c880 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:26.725188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499e36b-b3a8-440b-9cdb-7d1cf614a138 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:26.725468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499e36b-b3a8-440b-9cdb-7d1cf614a138 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:26.725767 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499e36b-b3a8-440b-9cdb-7d1cf614a138 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:26.726503 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499e36b-b3a8-440b-9cdb-7d1cf614a138 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:26.727067 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499e36b-b3a8-440b-9cdb-7d1cf614a138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:26.728474 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499e36b-b3a8-440b-9cdb-7d1cf614a138 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:26.733004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 38/75] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:26.734843 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202ae4b-70b2-4879-9f55-ea6648916b51 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:26.735134 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202ae4b-70b2-4879-9f55-ea6648916b51 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:26.735410 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202ae4b-70b2-4879-9f55-ea6648916b51 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:26.736897 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 38/76] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:52:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:26.738667 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 39/77] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:26.738777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499e36b-b3a8-440b-9cdb-7d1cf614a138 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:26.738849 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202ae4b-70b2-4879-9f55-ea6648916b51 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:26.830076 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499e36b-b3a8-440b-9cdb-7d1cf614a138 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:26.834154 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202ae4b-70b2-4879-9f55-ea6648916b51 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:26.863886 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058d2c2-66ef-4959-a55e-da694616aeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:26.864534 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058d2c2-66ef-4959-a55e-da694616aeec None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:26.864817 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058d2c2-66ef-4959-a55e-da694616aeec None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:26.865090 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058d2c2-66ef-4959-a55e-da694616aeec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:26.866898 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1ca9c-40a4-45eb-8f47-d8d2f2a6e890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:26.867718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1ca9c-40a4-45eb-8f47-d8d2f2a6e890 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:26.868014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1ca9c-40a4-45eb-8f47-d8d2f2a6e890 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:26.868298 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1ca9c-40a4-45eb-8f47-d8d2f2a6e890 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:26.878345 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1ca9c-40a4-45eb-8f47-d8d2f2a6e890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:26.886069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-b1f1ca9c-40a4-45eb-8f47-d8d2f2a6e890 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:26.886069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:26.886069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:26.886069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:26.886069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:26.886069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:26.886069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:26.886069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:26.886069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:26.886069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:26.886069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:26.886069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:26.886069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:26.886069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:26.886069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:26.886069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:26.886923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:26.886923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:26.886923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:26.886923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:26.886923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:26.886923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:26.886923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:26.886923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:26.886923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:26.886923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:26.886923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:26.886923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:52:26.886923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:26.886923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:26.886923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:26.886923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:26.893210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:26.893210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:26.893210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:26.893210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:26.893210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:26.893210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:26.893210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:26.893210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:26.893210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:26.893210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:26.893210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:26.893210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:52:26.893210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 40/78] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:26.893210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1ca9c-40a4-45eb-8f47-d8d2f2a6e890 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:26.929850 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058d2c2-66ef-4959-a55e-da694616aeec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:26.931349 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058d2c2-66ef-4959-a55e-da694616aeec None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:26.990274 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1ca9c-40a4-45eb-8f47-d8d2f2a6e890 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:27.021306 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb12ede-6d1a-49f7-ad31-629285ae4239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:27.022173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb12ede-6d1a-49f7-ad31-629285ae4239 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:27.022454 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb12ede-6d1a-49f7-ad31-629285ae4239 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:27.022730 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb12ede-6d1a-49f7-ad31-629285ae4239 None admin] PATH_INFO: `/v3/users/bbf536e8106349f196ff7b89dc343a4a` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:27.023935 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb12ede-6d1a-49f7-ad31-629285ae4239 None admin] RBAC: Authorizing `identity:get_user(user_id=bbf536e8106349f196ff7b89dc343a4a)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:27.025434 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb12ede-6d1a-49f7-ad31-629285ae4239 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:27.026067 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 39/79] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:52:27.031672 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 41/80] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:26 2022] GET /identity/v3/users/bbf536e8106349f196ff7b89dc343a4a => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:27.031806 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b478d6-39b2-45c1-9642-287ba44bb9a6 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:27.031806 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b478d6-39b2-45c1-9642-287ba44bb9a6 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:27.031983 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb12ede-6d1a-49f7-ad31-629285ae4239 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:27.032079 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b478d6-39b2-45c1-9642-287ba44bb9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:27.046032 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-35b478d6-39b2-45c1-9642-287ba44bb9a6 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:27.047225 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-35b478d6-39b2-45c1-9642-287ba44bb9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:27.109756 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 40/81] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:27.110612 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b478d6-39b2-45c1-9642-287ba44bb9a6 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:27.123714 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb12ede-6d1a-49f7-ad31-629285ae4239 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:27.155942 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26bd99-c1a1-4bf8-b0d5-32b630df1eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:27.156817 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26bd99-c1a1-4bf8-b0d5-32b630df1eda None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:27.157095 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26bd99-c1a1-4bf8-b0d5-32b630df1eda None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:27.157369 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26bd99-c1a1-4bf8-b0d5-32b630df1eda None admin] PATH_INFO: `/v3/users/3e0ac53f471746699df5c834e91784f1` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:27.159144 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26bd99-c1a1-4bf8-b0d5-32b630df1eda None admin] RBAC: Authorizing `identity:get_user(user_id=3e0ac53f471746699df5c834e91784f1)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:27.160626 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26bd99-c1a1-4bf8-b0d5-32b630df1eda None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:27.162401 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 42/82] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:27 2022] GET /identity/v3/users/3e0ac53f471746699df5c834e91784f1 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:27.163009 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26bd99-c1a1-4bf8-b0d5-32b630df1eda None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:27.206596 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b478d6-39b2-45c1-9642-287ba44bb9a6 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:27.239063 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad31753-ac89-41aa-91c0-7da2a4dc458c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:27.239762 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad31753-ac89-41aa-91c0-7da2a4dc458c None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:27.240046 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad31753-ac89-41aa-91c0-7da2a4dc458c None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:27.240375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad31753-ac89-41aa-91c0-7da2a4dc458c None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:27.241048 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad31753-ac89-41aa-91c0-7da2a4dc458c None admin] RBAC: Adding query filter params (name=member) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:27.241382 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad31753-ac89-41aa-91c0-7da2a4dc458c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:27.242767 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad31753-ac89-41aa-91c0-7da2a4dc458c None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:27.250653 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 41/83] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:52:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:27.252059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad31753-ac89-41aa-91c0-7da2a4dc458c None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:27.255938 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26bd99-c1a1-4bf8-b0d5-32b630df1eda None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:27.287482 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabc6d5-6540-4b42-bcd4-a982b15f34fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:27.288377 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabc6d5-6540-4b42-bcd4-a982b15f34fd None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:27.288656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabc6d5-6540-4b42-bcd4-a982b15f34fd None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:27.288931 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabc6d5-6540-4b42-bcd4-a982b15f34fd None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:27.290117 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabc6d5-6540-4b42-bcd4-a982b15f34fd None admin] RBAC: Authorizing `identity:get_project(project_id=f86e7cbe28eb448b87b50a4d37dce199)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:27.291571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabc6d5-6540-4b42-bcd4-a982b15f34fd None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:27.293274 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 43/84] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:27 2022] GET /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199 => generated 298 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:27.295137 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabc6d5-6540-4b42-bcd4-a982b15f34fd None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:27.345639 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad31753-ac89-41aa-91c0-7da2a4dc458c None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:27.377026 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019833f-c778-472c-9d6a-150fbc047b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:27.377667 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019833f-c778-472c-9d6a-150fbc047b7b None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:27.377951 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019833f-c778-472c-9d6a-150fbc047b7b None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:27.378220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019833f-c778-472c-9d6a-150fbc047b7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:27.387560 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabc6d5-6540-4b42-bcd4-a982b15f34fd None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:27.419451 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a2923-7185-4fb5-9e44-20a44874386a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:27.420256 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a2923-7185-4fb5-9e44-20a44874386a None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:27.420614 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a2923-7185-4fb5-9e44-20a44874386a None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:27.420915 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a2923-7185-4fb5-9e44-20a44874386a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:27.422070 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a2923-7185-4fb5-9e44-20a44874386a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:27.423530 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a2923-7185-4fb5-9e44-20a44874386a None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:27.425169 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 44/85] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:52:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:27.425943 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a2923-7185-4fb5-9e44-20a44874386a None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:27.445132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019833f-c778-472c-9d6a-150fbc047b7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:27.446610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019833f-c778-472c-9d6a-150fbc047b7b None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:27.519143 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a2923-7185-4fb5-9e44-20a44874386a None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:27.544833 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 42/86] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:52:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:52:27.546835 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019833f-c778-472c-9d6a-150fbc047b7b None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:27.550233 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cfb69-1fb6-482e-835b-bb6edd898364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:27.550881 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cfb69-1fb6-482e-835b-bb6edd898364 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:27.551163 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cfb69-1fb6-482e-835b-bb6edd898364 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:27.551440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cfb69-1fb6-482e-835b-bb6edd898364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:27.614153 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520cfb69-1fb6-482e-835b-bb6edd898364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:27.615660 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520cfb69-1fb6-482e-835b-bb6edd898364 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:27.638580 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019833f-c778-472c-9d6a-150fbc047b7b None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:27.670031 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d1537-ca82-4c16-824d-d94c30c15617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:27.670895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d1537-ca82-4c16-824d-d94c30c15617 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:27.671180 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d1537-ca82-4c16-824d-d94c30c15617 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:27.671462 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d1537-ca82-4c16-824d-d94c30c15617 None admin] PATH_INFO: `/v3/users/3e0ac53f471746699df5c834e91784f1` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:27.672702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d1537-ca82-4c16-824d-d94c30c15617 None admin] RBAC: Authorizing `identity:get_user(user_id=3e0ac53f471746699df5c834e91784f1)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:27.674654 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d1537-ca82-4c16-824d-d94c30c15617 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:27.676321 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 43/87] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:27 2022] GET /identity/v3/users/3e0ac53f471746699df5c834e91784f1 => generated 275 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:27.677178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d1537-ca82-4c16-824d-d94c30c15617 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:27.711070 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 45/88] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:52:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:52:27.712107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cfb69-1fb6-482e-835b-bb6edd898364 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:27.770181 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d1537-ca82-4c16-824d-d94c30c15617 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:27.802219 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cd23c-0ff3-4690-ac09-6b17789a65bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:27.802869 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cd23c-0ff3-4690-ac09-6b17789a65bb None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:27.803155 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cd23c-0ff3-4690-ac09-6b17789a65bb None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:27.803432 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cd23c-0ff3-4690-ac09-6b17789a65bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:27.804288 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cd23c-0ff3-4690-ac09-6b17789a65bb None admin] RBAC: Adding query filter params (role.id=0474b158b4bc4046ac169d53fff04721, scope.project.id=f86e7cbe28eb448b87b50a4d37dce199, user.id=3e0ac53f471746699df5c834e91784f1) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:27.804604 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cd23c-0ff3-4690-ac09-6b17789a65bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:27.805743 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cfb69-1fb6-482e-835b-bb6edd898364 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:27.806063 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cd23c-0ff3-4690-ac09-6b17789a65bb None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:27.813411 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 44/89] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:52:27 2022] GET /identity/v3/role_assignments?user.id=3e0ac53f471746699df5c834e91784f1&scope.project.id=f86e7cbe28eb448b87b50a4d37dce199&role.id=0474b158b4bc4046ac169d53fff04721 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:27.814764 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cd23c-0ff3-4690-ac09-6b17789a65bb None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:27.851123 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76884a0e-919f-45e6-9f41-fa7bf961e6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:27.852102 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76884a0e-919f-45e6-9f41-fa7bf961e6c7 None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:27.852389 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76884a0e-919f-45e6-9f41-fa7bf961e6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:27.852666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76884a0e-919f-45e6-9f41-fa7bf961e6c7 None admin] PATH_INFO: `/v3/users` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:27.853392 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76884a0e-919f-45e6-9f41-fa7bf961e6c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:27.854929 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76884a0e-919f-45e6-9f41-fa7bf961e6c7 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:27.876354 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 46/90] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 12 16:52:27 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:52:27.878275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76884a0e-919f-45e6-9f41-fa7bf961e6c7 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:27.946857 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cd23c-0ff3-4690-ac09-6b17789a65bb None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:27.988383 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab8190-47c0-4abe-b632-502db22b962d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:27.989040 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab8190-47c0-4abe-b632-502db22b962d None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:27.989328 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab8190-47c0-4abe-b632-502db22b962d None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:27.989607 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab8190-47c0-4abe-b632-502db22b962d None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:27.991069 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab8190-47c0-4abe-b632-502db22b962d None admin] RBAC: Authorizing `identity:get_project(project_id=f86e7cbe28eb448b87b50a4d37dce199)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:27.992666 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab8190-47c0-4abe-b632-502db22b962d None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:27.994705 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 45/91] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:27 2022] GET /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:27.994705 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab8190-47c0-4abe-b632-502db22b962d None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:28.012679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76884a0e-919f-45e6-9f41-fa7bf961e6c7 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:28.058313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01faa4-45e8-4550-ab0e-b5bd024b7fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:28.059905 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01faa4-45e8-4550-ab0e-b5bd024b7fa6 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:28.060579 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01faa4-45e8-4550-ab0e-b5bd024b7fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:28.061148 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01faa4-45e8-4550-ab0e-b5bd024b7fa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:28.108849 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab8190-47c0-4abe-b632-502db22b962d None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:28.147314 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01faa4-45e8-4550-ab0e-b5bd024b7fa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:28.148898 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01faa4-45e8-4550-ab0e-b5bd024b7fa6 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:28.155088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8e1c-96a6-4af8-b3c3-4cf95fd89611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:28.155997 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8e1c-96a6-4af8-b3c3-4cf95fd89611 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:28.156295 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8e1c-96a6-4af8-b3c3-4cf95fd89611 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:28.156563 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab8e1c-96a6-4af8-b3c3-4cf95fd89611 None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:28.158296 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab8e1c-96a6-4af8-b3c3-4cf95fd89611 None admin] RBAC: Authorizing `identity:get_project(project_id=f86e7cbe28eb448b87b50a4d37dce199)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:28.159839 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab8e1c-96a6-4af8-b3c3-4cf95fd89611 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:28.161567 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 46/92] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:27 2022] GET /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:28.163685 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8e1c-96a6-4af8-b3c3-4cf95fd89611 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:28.285868 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 47/93] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:52:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:52:28.286713 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01faa4-45e8-4550-ab0e-b5bd024b7fa6 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:28.301341 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab8e1c-96a6-4af8-b3c3-4cf95fd89611 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:28.342564 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4da51-9a75-486b-ba1a-97bed7f848f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:28.343149 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4da51-9a75-486b-ba1a-97bed7f848f9 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:28.344202 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4da51-9a75-486b-ba1a-97bed7f848f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:28.344202 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4da51-9a75-486b-ba1a-97bed7f848f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:28.344572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4da51-9a75-486b-ba1a-97bed7f848f9 None admin] RBAC: Adding query filter params (role.id=fbd6364b42a641f695c0b265a789057a, scope.project.id=f86e7cbe28eb448b87b50a4d37dce199, user.id=bbf536e8106349f196ff7b89dc343a4a) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:28.344887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4da51-9a75-486b-ba1a-97bed7f848f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:28.346936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4da51-9a75-486b-ba1a-97bed7f848f9 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:28.356473 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 47/94] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:52:28 2022] GET /identity/v3/role_assignments?user.id=bbf536e8106349f196ff7b89dc343a4a&scope.project.id=f86e7cbe28eb448b87b50a4d37dce199&role.id=fbd6364b42a641f695c0b265a789057a => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:28.357504 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4da51-9a75-486b-ba1a-97bed7f848f9 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:28.425789 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01faa4-45e8-4550-ab0e-b5bd024b7fa6 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:28.506436 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8107a-3fd4-4fcc-856c-4c111bcbf218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:28.507482 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8107a-3fd4-4fcc-856c-4c111bcbf218 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:28.508020 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8107a-3fd4-4fcc-856c-4c111bcbf218 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:28.508500 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8107a-3fd4-4fcc-856c-4c111bcbf218 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:28.509556 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8107a-3fd4-4fcc-856c-4c111bcbf218 None admin] RBAC: Adding query filter params (role.id=f45adb34d54d49558694df72aec6b99d, scope.project.id=f86e7cbe28eb448b87b50a4d37dce199, user.id=3e0ac53f471746699df5c834e91784f1) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:28.510109 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8107a-3fd4-4fcc-856c-4c111bcbf218 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:28.511859 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8107a-3fd4-4fcc-856c-4c111bcbf218 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:28.524832 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 48/95] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:52:28 2022] GET /identity/v3/role_assignments?user.id=3e0ac53f471746699df5c834e91784f1&scope.project.id=f86e7cbe28eb448b87b50a4d37dce199&role.id=f45adb34d54d49558694df72aec6b99d => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:28.548127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4da51-9a75-486b-ba1a-97bed7f848f9 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:28.590681 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ca999-024d-4d3a-aa3b-57e79bffa97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:28.592013 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ca999-024d-4d3a-aa3b-57e79bffa97d None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:28.592503 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ca999-024d-4d3a-aa3b-57e79bffa97d None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:28.593134 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ca999-024d-4d3a-aa3b-57e79bffa97d None admin] PATH_INFO: `/v3/projects/7ffaaac54a994dbfa9e9bc89600c2fd9` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:28.596558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ca999-024d-4d3a-aa3b-57e79bffa97d None admin] RBAC: Authorizing `identity:get_project(project_id=7ffaaac54a994dbfa9e9bc89600c2fd9)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:28.598328 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ca999-024d-4d3a-aa3b-57e79bffa97d None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:28.600363 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 48/96] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:28 2022] GET /identity/v3/projects/7ffaaac54a994dbfa9e9bc89600c2fd9 => generated 312 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:28.607759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8107a-3fd4-4fcc-856c-4c111bcbf218 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:28.735937 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8107a-3fd4-4fcc-856c-4c111bcbf218 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:28.773813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63674b-e325-44b7-8ed7-bd57095a4de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:28.774853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63674b-e325-44b7-8ed7-bd57095a4de4 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:28.775359 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63674b-e325-44b7-8ed7-bd57095a4de4 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:28.775877 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63674b-e325-44b7-8ed7-bd57095a4de4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:28.776913 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63674b-e325-44b7-8ed7-bd57095a4de4 None admin] RBAC: Adding query filter params (role.id=0474b158b4bc4046ac169d53fff04721, scope.project.id=7ffaaac54a994dbfa9e9bc89600c2fd9, user.id=3e0ac53f471746699df5c834e91784f1) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:28.777426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63674b-e325-44b7-8ed7-bd57095a4de4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:28.779193 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63674b-e325-44b7-8ed7-bd57095a4de4 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:28.785360 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 49/97] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:52:28 2022] GET /identity/v3/role_assignments?user.id=3e0ac53f471746699df5c834e91784f1&scope.project.id=7ffaaac54a994dbfa9e9bc89600c2fd9&role.id=0474b158b4bc4046ac169d53fff04721 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:30.847235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6da2d-8214-4ccd-8896-1ab47be211ce None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:30.848293 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6da2d-8214-4ccd-8896-1ab47be211ce None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:30.848809 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6da2d-8214-4ccd-8896-1ab47be211ce None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:30.850718 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 49/98] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:30.857412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c79c3-fdfb-4884-9f44-241a39db97a1 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:30.858293 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c79c3-fdfb-4884-9f44-241a39db97a1 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:30.858792 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c79c3-fdfb-4884-9f44-241a39db97a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:30.880658 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-239c79c3-fdfb-4884-9f44-241a39db97a1 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:30.882173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-239c79c3-fdfb-4884-9f44-241a39db97a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:30.971029 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 50/99] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:31.002043 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6da2d-8214-4ccd-8896-1ab47be211ce None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:31.120233 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6da2d-8214-4ccd-8896-1ab47be211ce None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:31.164549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960a7ec-e6b3-4647-88ab-8d7c6457d751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:31.165719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960a7ec-e6b3-4647-88ab-8d7c6457d751 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:31.166215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960a7ec-e6b3-4647-88ab-8d7c6457d751 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:31.166698 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960a7ec-e6b3-4647-88ab-8d7c6457d751 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:31.184522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960a7ec-e6b3-4647-88ab-8d7c6457d751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:31.193542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-3960a7ec-e6b3-4647-88ab-8d7c6457d751 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:52:31.193542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:31.193542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:31.193542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:31.193542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:31.193542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:31.193542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:31.193542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:31.193542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:31.193542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:31.193542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:31.193542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:31.193542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:31.193542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:31.193542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:31.193542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:31.194403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:31.194403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:31.194403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:31.194403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:31.194403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:31.194403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:31.194403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:31.194403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:31.194403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:31.194403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:31.194403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:31.194403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:52:31.194403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:31.194403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:31.194403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:31.194403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:31.195184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:31.195184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:31.195184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:31.195184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:31.195184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:31.195184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:31.195184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:31.195184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:31.195184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:31.195184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:31.195184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:52:31.195184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:52:31.197843 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 50/100] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:31.203442 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c79c3-fdfb-4884-9f44-241a39db97a1 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:31.258627 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f0318-9f17-42a1-b7b1-1fe160356768 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:31.259270 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f0318-9f17-42a1-b7b1-1fe160356768 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:31.259793 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f0318-9f17-42a1-b7b1-1fe160356768 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:31.261385 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 51/101] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:31.266349 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7adb9-689d-4da8-82b6-101046295b28 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:31.266923 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7adb9-689d-4da8-82b6-101046295b28 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:31.267413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7adb9-689d-4da8-82b6-101046295b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:31.293997 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-90c7adb9-689d-4da8-82b6-101046295b28 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:31.296892 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-90c7adb9-689d-4da8-82b6-101046295b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:31.378246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c79c3-fdfb-4884-9f44-241a39db97a1 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:31.409362 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 52/102] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:52:31.432435 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56925d0-9491-4824-a9ac-3703f4dee916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:31.433490 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56925d0-9491-4824-a9ac-3703f4dee916 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:31.433985 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56925d0-9491-4824-a9ac-3703f4dee916 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:31.434523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56925d0-9491-4824-a9ac-3703f4dee916 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:31.435478 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56925d0-9491-4824-a9ac-3703f4dee916 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:31.436022 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56925d0-9491-4824-a9ac-3703f4dee916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:31.437632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56925d0-9491-4824-a9ac-3703f4dee916 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:31.451316 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 51/103] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:52:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:31.455237 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7adb9-689d-4da8-82b6-101046295b28 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:31.457270 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56925d0-9491-4824-a9ac-3703f4dee916 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:31.561087 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56925d0-9491-4824-a9ac-3703f4dee916 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:31.608392 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c105b-546c-4b33-beb0-6b708415b701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:31.609298 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c105b-546c-4b33-beb0-6b708415b701 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:31.609583 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c105b-546c-4b33-beb0-6b708415b701 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:31.609865 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c105b-546c-4b33-beb0-6b708415b701 None admin] PATH_INFO: `/v3/users/5ac3b057b1004c9a8134a5691db06b9d` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:31.629985 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c105b-546c-4b33-beb0-6b708415b701 None admin] RBAC: Authorizing `identity:get_user(user_id=5ac3b057b1004c9a8134a5691db06b9d)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:31.631489 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c105b-546c-4b33-beb0-6b708415b701 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:31.633642 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 52/104] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:31 2022] GET /identity/v3/users/5ac3b057b1004c9a8134a5691db06b9d => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:52:31.638736 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c105b-546c-4b33-beb0-6b708415b701 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:31.701773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7adb9-689d-4da8-82b6-101046295b28 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:31.761637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c105b-546c-4b33-beb0-6b708415b701 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:31.769267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8b1c8-d744-4f7b-9793-eb391d15be81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:31.770088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8b1c8-d744-4f7b-9793-eb391d15be81 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:31.770372 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8b1c8-d744-4f7b-9793-eb391d15be81 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:31.770648 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8b1c8-d744-4f7b-9793-eb391d15be81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:31.776586 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8b1c8-d744-4f7b-9793-eb391d15be81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:31.778106 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8b1c8-d744-4f7b-9793-eb391d15be81 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:31.780097 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 53/105] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:52:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:31.786037 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8b1c8-d744-4f7b-9793-eb391d15be81 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:31.808506 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6784f3-2a94-43c2-973b-9536d10dd6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:31.809185 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6784f3-2a94-43c2-973b-9536d10dd6ca None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:31.809473 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6784f3-2a94-43c2-973b-9536d10dd6ca None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:31.809753 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6784f3-2a94-43c2-973b-9536d10dd6ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:31.913477 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6784f3-2a94-43c2-973b-9536d10dd6ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:31.919858 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6784f3-2a94-43c2-973b-9536d10dd6ca None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:31.931138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8b1c8-d744-4f7b-9793-eb391d15be81 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:31.966542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccd8a0-0418-4cd6-983e-6ead9bf6542d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:31.967209 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccd8a0-0418-4cd6-983e-6ead9bf6542d None admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:31.967494 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccd8a0-0418-4cd6-983e-6ead9bf6542d None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:31.967805 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccd8a0-0418-4cd6-983e-6ead9bf6542d None admin] PATH_INFO: `/v3/projects` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:31.968518 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccd8a0-0418-4cd6-983e-6ead9bf6542d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:31.970008 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccd8a0-0418-4cd6-983e-6ead9bf6542d None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:32.003347 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 54/106] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 12 16:52:31 2022] POST /identity/v3/projects => generated 302 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:52:32.004793 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b3699-6b6b-482f-a6b3-0c743ecdad08 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:32.005140 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b3699-6b6b-482f-a6b3-0c743ecdad08 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:32.005432 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b3699-6b6b-482f-a6b3-0c743ecdad08 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:32.006866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 55/107] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:32.007860 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f169f8-3327-4013-b3c6-1486a424a4ca None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:32.008107 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f169f8-3327-4013-b3c6-1486a424a4ca None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:32.008391 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f169f8-3327-4013-b3c6-1486a424a4ca None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:32.009673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 56/108] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:32.015283 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df69359-2769-4e56-9552-cc87630ab587 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:32.015609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df69359-2769-4e56-9552-cc87630ab587 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:32.015914 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df69359-2769-4e56-9552-cc87630ab587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:32.019304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 53/109] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:52:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 16:52:32.020572 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07361f1-3629-4af9-95e6-0e1c6cf6ef94 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:32.020866 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07361f1-3629-4af9-95e6-0e1c6cf6ef94 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:32.021141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07361f1-3629-4af9-95e6-0e1c6cf6ef94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:32.035141 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-6df69359-2769-4e56-9552-cc87630ab587 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:32.036452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-6df69359-2769-4e56-9552-cc87630ab587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:32.040048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-b07361f1-3629-4af9-95e6-0e1c6cf6ef94 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:32.041375 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-b07361f1-3629-4af9-95e6-0e1c6cf6ef94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:32.111815 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 57/110] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:32.112715 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df69359-2769-4e56-9552-cc87630ab587 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:32.116747 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 54/111] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:32.118304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd609835-8177-458a-bec6-fba8bc70ddd4 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:32.118593 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd609835-8177-458a-bec6-fba8bc70ddd4 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:32.118869 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd609835-8177-458a-bec6-fba8bc70ddd4 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:32.120555 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 55/112] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:32.127379 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddeaf7-fa12-4e4e-a96b-453da873d99d None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:32.127656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddeaf7-fa12-4e4e-a96b-453da873d99d None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:32.127917 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddeaf7-fa12-4e4e-a96b-453da873d99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:32.162120 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-f1ddeaf7-fa12-4e4e-a96b-453da873d99d None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:32.163324 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-f1ddeaf7-fa12-4e4e-a96b-453da873d99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:32.238623 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 56/113] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:32.239154 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddeaf7-fa12-4e4e-a96b-453da873d99d None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:32.246181 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df69359-2769-4e56-9552-cc87630ab587 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:32.298659 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5134d9-71b4-4338-8432-705579d5d58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:32.300541 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5134d9-71b4-4338-8432-705579d5d58f None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:32.301351 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5134d9-71b4-4338-8432-705579d5d58f None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:32.301908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5134d9-71b4-4338-8432-705579d5d58f None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:32.303078 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5134d9-71b4-4338-8432-705579d5d58f None admin] RBAC: Authorizing `identity:get_project(project_id=f86e7cbe28eb448b87b50a4d37dce199)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:32.304561 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5134d9-71b4-4338-8432-705579d5d58f None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:32.306450 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 58/114] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:32 2022] GET /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:32.307033 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5134d9-71b4-4338-8432-705579d5d58f None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:32.364505 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddeaf7-fa12-4e4e-a96b-453da873d99d None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:32.409425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b688041-4bb0-44ef-9238-9e02160c1306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:32.410233 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b688041-4bb0-44ef-9238-9e02160c1306 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:32.410664 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b688041-4bb0-44ef-9238-9e02160c1306 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:32.410995 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b688041-4bb0-44ef-9238-9e02160c1306 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:32.416755 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5134d9-71b4-4338-8432-705579d5d58f None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:32.426127 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b688041-4bb0-44ef-9238-9e02160c1306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:32.436759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-4b688041-4bb0-44ef-9238-9e02160c1306 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:32.436759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:32.436759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:32.436759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:32.436759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:32.436759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:32.436759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:32.436759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:32.436759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:32.436759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:32.436759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:32.436759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:32.436759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:32.436759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:32.436759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:32.436759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:32.437998 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:32.437998 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:32.437998 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:32.437998 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:32.437998 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:32.437998 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:32.437998 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:32.437998 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:32.437998 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:32.437998 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:32.437998 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:32.437998 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:52:32.437998 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:32.437998 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:32.437998 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:32.437998 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:32.439298 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:32.439298 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:32.439298 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:32.439298 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:32.439298 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:32.439298 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:32.439298 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:32.439298 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:32.439298 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:32.439298 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:32.439298 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:32.439298 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:52:32.439298 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 57/115] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:32.442259 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b688041-4bb0-44ef-9238-9e02160c1306 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:32.468629 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68555610-36d1-4cb9-95b3-679bdc7c2731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:32.469428 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68555610-36d1-4cb9-95b3-679bdc7c2731 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:32.469710 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68555610-36d1-4cb9-95b3-679bdc7c2731 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:32.470507 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68555610-36d1-4cb9-95b3-679bdc7c2731 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:32.480825 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68555610-36d1-4cb9-95b3-679bdc7c2731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:32.489165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-68555610-36d1-4cb9-95b3-679bdc7c2731 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:32.489165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:32.489165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:32.489165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:32.489165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:32.489165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:32.489165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:32.489165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:32.489165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:32.489165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:32.489165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:32.489165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:32.489165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:32.489165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:32.489165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:32.489165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:32.490042 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:32.490042 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:32.490042 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:32.490042 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:32.490042 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:32.490042 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:32.490042 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:32.490042 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:32.490042 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:32.490042 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:32.490042 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:32.490042 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:52:32.490042 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:32.490042 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:32.490042 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:32.490042 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:32.494813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:32.494813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:32.494813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:32.494813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:32.494813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:32.494813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:32.494813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:32.494813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:32.494813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:32.494813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:32.494813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:32.494813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:52:32.494813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 59/116] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:32.494813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68555610-36d1-4cb9-95b3-679bdc7c2731 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:32.575008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b688041-4bb0-44ef-9238-9e02160c1306 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:32.596290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68555610-36d1-4cb9-95b3-679bdc7c2731 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:32.615561 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30dd8d-d844-4797-8f1f-9fca01af2b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:32.616420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30dd8d-d844-4797-8f1f-9fca01af2b42 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:32.616703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30dd8d-d844-4797-8f1f-9fca01af2b42 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:32.616983 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30dd8d-d844-4797-8f1f-9fca01af2b42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:32.626919 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30dd8d-d844-4797-8f1f-9fca01af2b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:32.630372 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f7d49-2454-4575-98d3-e564aaa9274c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:32.631232 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f7d49-2454-4575-98d3-e564aaa9274c None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:32.631715 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f7d49-2454-4575-98d3-e564aaa9274c None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:32.632226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f7d49-2454-4575-98d3-e564aaa9274c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:32.633218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f7d49-2454-4575-98d3-e564aaa9274c None admin] RBAC: Adding query filter params (role.id=2088f05fbc394bb4a8b98c44c2af1309, scope.project.id=f86e7cbe28eb448b87b50a4d37dce199, user.id=5ac3b057b1004c9a8134a5691db06b9d) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:32.633715 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f7d49-2454-4575-98d3-e564aaa9274c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:32.634637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-cc30dd8d-d844-4797-8f1f-9fca01af2b42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:52:32.634637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:32.634637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:32.634637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:32.634637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:32.634637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:32.634637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:32.634637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:32.634637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:32.634637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:32.634637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:32.634637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:32.634637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:32.634637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:32.634637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:32.634637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:32.635415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:32.635415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:32.635415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:32.635415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:32.635415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:32.635415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:32.635415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:32.635415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:32.635415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:32.635415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:32.635415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:32.635415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:52:32.635415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:32.635415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:32.635415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:32.635415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:32.636248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:32.636248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:32.636248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:32.636248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:32.636248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:32.636248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:32.636248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:32.636248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:32.636248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:32.636248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:32.636248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:52:32.636248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:52:32.636248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 58/117] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 12 16:52:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:32.636999 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30dd8d-d844-4797-8f1f-9fca01af2b42 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:32.637883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f7d49-2454-4575-98d3-e564aaa9274c None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:32.644741 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 60/118] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:52:32 2022] GET /identity/v3/role_assignments?user.id=5ac3b057b1004c9a8134a5691db06b9d&scope.project.id=f86e7cbe28eb448b87b50a4d37dce199&role.id=2088f05fbc394bb4a8b98c44c2af1309 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:32.646159 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f7d49-2454-4575-98d3-e564aaa9274c None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:32.754605 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30dd8d-d844-4797-8f1f-9fca01af2b42 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:32.771428 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f7d49-2454-4575-98d3-e564aaa9274c None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:32.791680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbba734-fab3-462a-b306-389ffed5b673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:32.792851 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbba734-fab3-462a-b306-389ffed5b673 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:32.793359 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbba734-fab3-462a-b306-389ffed5b673 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:32.793840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbba734-fab3-462a-b306-389ffed5b673 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:32.795248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbba734-fab3-462a-b306-389ffed5b673 None admin] RBAC: Adding query filter params (name=member) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:32.796179 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbba734-fab3-462a-b306-389ffed5b673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:32.798020 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbba734-fab3-462a-b306-389ffed5b673 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:32.811694 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 59/119] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:52:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:32.811694 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b46aa-ca55-45db-b5bb-7ba88ad0abb9 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:32.812333 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b46aa-ca55-45db-b5bb-7ba88ad0abb9 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:32.813056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b46aa-ca55-45db-b5bb-7ba88ad0abb9 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:32.814973 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 60/120] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:32.816075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b46aa-ca55-45db-b5bb-7ba88ad0abb9 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:32.816563 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cd8cc-a38e-43ff-a94b-2169ba376429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:32.817348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cd8cc-a38e-43ff-a94b-2169ba376429 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:32.817737 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cd8cc-a38e-43ff-a94b-2169ba376429 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:32.818117 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cd8cc-a38e-43ff-a94b-2169ba376429 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:32.819279 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1cd8cc-a38e-43ff-a94b-2169ba376429 None admin] RBAC: Adding query filter params (name=member) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:32.819897 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1cd8cc-a38e-43ff-a94b-2169ba376429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:32.821666 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1cd8cc-a38e-43ff-a94b-2169ba376429 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:32.830319 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 61/121] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:52:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:32.836107 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cd8cc-a38e-43ff-a94b-2169ba376429 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:32.931659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b46aa-ca55-45db-b5bb-7ba88ad0abb9 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:32.944267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cd8cc-a38e-43ff-a94b-2169ba376429 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:32.960823 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05728c6b-d248-484c-8a13-119410784f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:32.961680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05728c6b-d248-484c-8a13-119410784f9d None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:32.961961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05728c6b-d248-484c-8a13-119410784f9d None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:32.962240 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05728c6b-d248-484c-8a13-119410784f9d None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:32.962995 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05728c6b-d248-484c-8a13-119410784f9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:32.963304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05728c6b-d248-484c-8a13-119410784f9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:32.964716 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05728c6b-d248-484c-8a13-119410784f9d None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:32.974517 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 61/122] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:32.975832 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d31da-0407-4f4e-bb05-0c1673021ee2 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:32.976119 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d31da-0407-4f4e-bb05-0c1673021ee2 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:32.976395 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d31da-0407-4f4e-bb05-0c1673021ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:32.982141 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb826dd-b746-4218-856f-19393ea7c7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:32.983013 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb826dd-b746-4218-856f-19393ea7c7ea None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:32.983347 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb826dd-b746-4218-856f-19393ea7c7ea None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:32.983653 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb826dd-b746-4218-856f-19393ea7c7ea None admin] PATH_INFO: `/v3/users/3e0ac53f471746699df5c834e91784f1` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:32.984843 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb826dd-b746-4218-856f-19393ea7c7ea None admin] RBAC: Authorizing `identity:get_user(user_id=3e0ac53f471746699df5c834e91784f1)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:32.986377 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb826dd-b746-4218-856f-19393ea7c7ea None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:32.992695 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 62/123] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:32 2022] GET /identity/v3/users/3e0ac53f471746699df5c834e91784f1 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:32.993204 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-140d31da-0407-4f4e-bb05-0c1673021ee2 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:32.993623 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb826dd-b746-4218-856f-19393ea7c7ea None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:32.994491 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-140d31da-0407-4f4e-bb05-0c1673021ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:33.061066 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 62/124] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:33.062027 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d31da-0407-4f4e-bb05-0c1673021ee2 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:33.094208 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb826dd-b746-4218-856f-19393ea7c7ea None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:33.128942 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585aaba2-6d1e-4452-bd7e-721d0407b53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:33.129812 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585aaba2-6d1e-4452-bd7e-721d0407b53b None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:33.130089 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585aaba2-6d1e-4452-bd7e-721d0407b53b None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:33.130365 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585aaba2-6d1e-4452-bd7e-721d0407b53b None admin] PATH_INFO: `/v3/users/3e0ac53f471746699df5c834e91784f1` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:33.131558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585aaba2-6d1e-4452-bd7e-721d0407b53b None admin] RBAC: Authorizing `identity:get_user(user_id=3e0ac53f471746699df5c834e91784f1)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:33.133038 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585aaba2-6d1e-4452-bd7e-721d0407b53b None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:33.134946 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 63/125] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:32 2022] GET /identity/v3/users/3e0ac53f471746699df5c834e91784f1 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:33.139889 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585aaba2-6d1e-4452-bd7e-721d0407b53b None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:33.159872 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d31da-0407-4f4e-bb05-0c1673021ee2 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:33.192531 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477b2d3-20a5-480f-a60a-dbff65d81425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:33.193403 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477b2d3-20a5-480f-a60a-dbff65d81425 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:33.193681 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477b2d3-20a5-480f-a60a-dbff65d81425 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:33.193958 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477b2d3-20a5-480f-a60a-dbff65d81425 None admin] PATH_INFO: `/v3/users/bbf536e8106349f196ff7b89dc343a4a` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:33.195137 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477b2d3-20a5-480f-a60a-dbff65d81425 None admin] RBAC: Authorizing `identity:get_user(user_id=bbf536e8106349f196ff7b89dc343a4a)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:33.196620 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477b2d3-20a5-480f-a60a-dbff65d81425 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:33.198244 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 63/126] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:33 2022] GET /identity/v3/users/bbf536e8106349f196ff7b89dc343a4a => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:33.199008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477b2d3-20a5-480f-a60a-dbff65d81425 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:33.244736 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585aaba2-6d1e-4452-bd7e-721d0407b53b None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:33.285275 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b7372-d1c6-4603-b40c-e31c67c10324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:33.286180 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b7372-d1c6-4603-b40c-e31c67c10324 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:33.286461 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b7372-d1c6-4603-b40c-e31c67c10324 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:33.286733 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b7372-d1c6-4603-b40c-e31c67c10324 None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:33.287969 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b7372-d1c6-4603-b40c-e31c67c10324 None admin] RBAC: Authorizing `identity:get_project(project_id=f86e7cbe28eb448b87b50a4d37dce199)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:33.289412 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b7372-d1c6-4603-b40c-e31c67c10324 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:33.291532 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 64/127] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:33 2022] GET /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:33.292334 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b7372-d1c6-4603-b40c-e31c67c10324 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:33.321290 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477b2d3-20a5-480f-a60a-dbff65d81425 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:33.358770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82470f23-5bdb-42c2-94f4-5ef12c08b61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:33.359600 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82470f23-5bdb-42c2-94f4-5ef12c08b61a None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:33.359924 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82470f23-5bdb-42c2-94f4-5ef12c08b61a None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:33.360195 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82470f23-5bdb-42c2-94f4-5ef12c08b61a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:33.371286 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82470f23-5bdb-42c2-94f4-5ef12c08b61a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:33.379805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-82470f23-5bdb-42c2-94f4-5ef12c08b61a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:52:33.379805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:33.379805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:33.379805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:33.379805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:33.379805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:33.379805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:33.379805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:33.379805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:33.379805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:33.379805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:33.379805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:33.379805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:33.379805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:33.379805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:33.379805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:33.380701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:33.380701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:33.380701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:33.380701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:33.380701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:33.380701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:33.380701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:33.380701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:33.380701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:33.380701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:33.380701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:33.380701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:52:33.380701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:33.380701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:33.380701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:33.380701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:33.382048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:33.382048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:33.382048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:33.382048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:33.382048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:33.382048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:33.382048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:33.382048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:33.382048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:33.382048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:33.382048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:52:33.382048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:52:33.382048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 64/128] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:52:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:33.382048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82470f23-5bdb-42c2-94f4-5ef12c08b61a None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:33.406141 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b7372-d1c6-4603-b40c-e31c67c10324 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:33.449841 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772b9f0-4186-4dfb-99b9-5a67cac58138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:33.451991 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772b9f0-4186-4dfb-99b9-5a67cac58138 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:33.452524 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772b9f0-4186-4dfb-99b9-5a67cac58138 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:33.453017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772b9f0-4186-4dfb-99b9-5a67cac58138 None admin] PATH_INFO: `/v3/projects/7ffaaac54a994dbfa9e9bc89600c2fd9` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:33.454489 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772b9f0-4186-4dfb-99b9-5a67cac58138 None admin] RBAC: Authorizing `identity:get_project(project_id=7ffaaac54a994dbfa9e9bc89600c2fd9)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:33.456698 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772b9f0-4186-4dfb-99b9-5a67cac58138 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:33.459995 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 65/129] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:33 2022] GET /identity/v3/projects/7ffaaac54a994dbfa9e9bc89600c2fd9 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:33.461056 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772b9f0-4186-4dfb-99b9-5a67cac58138 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:33.484769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82470f23-5bdb-42c2-94f4-5ef12c08b61a None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:33.519931 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144c35b-0c6b-4973-be23-e0df53b1b5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:33.520807 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144c35b-0c6b-4973-be23-e0df53b1b5fe None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:33.521092 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144c35b-0c6b-4973-be23-e0df53b1b5fe None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:33.521368 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144c35b-0c6b-4973-be23-e0df53b1b5fe None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:33.522680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144c35b-0c6b-4973-be23-e0df53b1b5fe None admin] RBAC: Authorizing `identity:get_project(project_id=f86e7cbe28eb448b87b50a4d37dce199)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:33.524210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144c35b-0c6b-4973-be23-e0df53b1b5fe None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:33.525902 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 65/130] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:33 2022] GET /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:33.530709 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144c35b-0c6b-4973-be23-e0df53b1b5fe None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:33.600417 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772b9f0-4186-4dfb-99b9-5a67cac58138 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:33.633431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144c35b-0c6b-4973-be23-e0df53b1b5fe None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:33.644553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68fc4a-a65a-47a3-abd1-52cb764cfccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:33.645976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68fc4a-a65a-47a3-abd1-52cb764cfccd None admin] REQUEST_METHOD: `PUT` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:33.646621 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68fc4a-a65a-47a3-abd1-52cb764cfccd None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:33.647487 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68fc4a-a65a-47a3-abd1-52cb764cfccd None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199/users/3e0ac53f471746699df5c834e91784f1/roles/0474b158b4bc4046ac169d53fff04721` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:33.650461 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68fc4a-a65a-47a3-abd1-52cb764cfccd None admin] RBAC: Authorizing `identity:create_grant(project_id=f86e7cbe28eb448b87b50a4d37dce199, user_id=3e0ac53f471746699df5c834e91784f1, role_id=0474b158b4bc4046ac169d53fff04721)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:33.652290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68fc4a-a65a-47a3-abd1-52cb764cfccd None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:33.668767 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 66/131] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 12 16:52:33 2022] PUT /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199/users/3e0ac53f471746699df5c834e91784f1/roles/0474b158b4bc4046ac169d53fff04721 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:52:33.669962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68fc4a-a65a-47a3-abd1-52cb764cfccd None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:33.676741 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01caaf-65fb-48fb-890b-f6abc14cbfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:33.677501 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01caaf-65fb-48fb-890b-f6abc14cbfe3 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:33.677775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01caaf-65fb-48fb-890b-f6abc14cbfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:33.678135 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01caaf-65fb-48fb-890b-f6abc14cbfe3 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:33.678990 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01caaf-65fb-48fb-890b-f6abc14cbfe3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:33.679317 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01caaf-65fb-48fb-890b-f6abc14cbfe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:33.680785 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01caaf-65fb-48fb-890b-f6abc14cbfe3 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:33.694377 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 66/132] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:52:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:33.695232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01caaf-65fb-48fb-890b-f6abc14cbfe3 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:33.794216 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68fc4a-a65a-47a3-abd1-52cb764cfccd None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:33.836725 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f82f6-86fb-47b5-ab56-bbf56d5739c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:33.838058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f82f6-86fb-47b5-ab56-bbf56d5739c1 None admin] REQUEST_METHOD: `PUT` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:33.838571 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f82f6-86fb-47b5-ab56-bbf56d5739c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:33.839123 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f82f6-86fb-47b5-ab56-bbf56d5739c1 None admin] PATH_INFO: `/v3/projects/7ffaaac54a994dbfa9e9bc89600c2fd9/users/3e0ac53f471746699df5c834e91784f1/roles/0474b158b4bc4046ac169d53fff04721` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:33.841633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f82f6-86fb-47b5-ab56-bbf56d5739c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ffaaac54a994dbfa9e9bc89600c2fd9, user_id=3e0ac53f471746699df5c834e91784f1, role_id=0474b158b4bc4046ac169d53fff04721)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:33.843393 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f82f6-86fb-47b5-ab56-bbf56d5739c1 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:33.862965 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 67/133] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 12 16:52:33 2022] PUT /identity/v3/projects/7ffaaac54a994dbfa9e9bc89600c2fd9/users/3e0ac53f471746699df5c834e91784f1/roles/0474b158b4bc4046ac169d53fff04721 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:52:33.864538 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f82f6-86fb-47b5-ab56-bbf56d5739c1 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:33.898764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01caaf-65fb-48fb-890b-f6abc14cbfe3 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:33.979388 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a6b93-cb58-45e1-a7e5-c0e00fda5992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:33.980427 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a6b93-cb58-45e1-a7e5-c0e00fda5992 None admin] REQUEST_METHOD: `PUT` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:33.980711 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a6b93-cb58-45e1-a7e5-c0e00fda5992 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:33.980999 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a6b93-cb58-45e1-a7e5-c0e00fda5992 None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199/users/bbf536e8106349f196ff7b89dc343a4a/roles/fbd6364b42a641f695c0b265a789057a` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:33.989314 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a6b93-cb58-45e1-a7e5-c0e00fda5992 None admin] RBAC: Authorizing `identity:create_grant(project_id=f86e7cbe28eb448b87b50a4d37dce199, user_id=bbf536e8106349f196ff7b89dc343a4a, role_id=fbd6364b42a641f695c0b265a789057a)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:33.991773 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a6b93-cb58-45e1-a7e5-c0e00fda5992 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:33.997741 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f82f6-86fb-47b5-ab56-bbf56d5739c1 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:34.025052 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 67/134] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 12 16:52:33 2022] PUT /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199/users/bbf536e8106349f196ff7b89dc343a4a/roles/fbd6364b42a641f695c0b265a789057a => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:52:34.042700 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb1ff8-da9c-48d9-876a-a9f928ce5f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:34.043598 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb1ff8-da9c-48d9-876a-a9f928ce5f7c None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:34.043928 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb1ff8-da9c-48d9-876a-a9f928ce5f7c None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:34.044207 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb1ff8-da9c-48d9-876a-a9f928ce5f7c None admin] PATH_INFO: `/v3/users/3e0ac53f471746699df5c834e91784f1` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:34.045666 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb1ff8-da9c-48d9-876a-a9f928ce5f7c None admin] RBAC: Authorizing `identity:get_user(user_id=3e0ac53f471746699df5c834e91784f1)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:34.047461 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb1ff8-da9c-48d9-876a-a9f928ce5f7c None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:34.049475 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 68/135] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:33 2022] GET /identity/v3/users/3e0ac53f471746699df5c834e91784f1 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:34.055470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a6b93-cb58-45e1-a7e5-c0e00fda5992 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:34.185306 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a6b93-cb58-45e1-a7e5-c0e00fda5992 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:34.224319 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286ee1d-ea33-41fc-8881-e083d44b78f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:34.225571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286ee1d-ea33-41fc-8881-e083d44b78f4 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:34.226085 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286ee1d-ea33-41fc-8881-e083d44b78f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:34.226567 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286ee1d-ea33-41fc-8881-e083d44b78f4 None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:34.228356 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286ee1d-ea33-41fc-8881-e083d44b78f4 None admin] RBAC: Authorizing `identity:get_project(project_id=f86e7cbe28eb448b87b50a4d37dce199)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:34.230120 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286ee1d-ea33-41fc-8881-e083d44b78f4 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:34.232553 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 68/136] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:34 2022] GET /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:34.238766 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb1ff8-da9c-48d9-876a-a9f928ce5f7c None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:34.355020 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb1ff8-da9c-48d9-876a-a9f928ce5f7c None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:34.389578 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d9405-802e-4420-b7da-4fe85fe18373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:34.390473 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d9405-802e-4420-b7da-4fe85fe18373 None admin] REQUEST_METHOD: `PUT` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:34.390756 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d9405-802e-4420-b7da-4fe85fe18373 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:34.391031 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d9405-802e-4420-b7da-4fe85fe18373 None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199/users/3e0ac53f471746699df5c834e91784f1/roles/f45adb34d54d49558694df72aec6b99d` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:34.393330 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d9405-802e-4420-b7da-4fe85fe18373 None admin] RBAC: Authorizing `identity:create_grant(project_id=f86e7cbe28eb448b87b50a4d37dce199, user_id=3e0ac53f471746699df5c834e91784f1, role_id=f45adb34d54d49558694df72aec6b99d)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:34.394778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d9405-802e-4420-b7da-4fe85fe18373 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:34.412132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 69/137] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 12 16:52:34 2022] PUT /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199/users/3e0ac53f471746699df5c834e91784f1/roles/f45adb34d54d49558694df72aec6b99d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:52:34.820801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7845c2-f259-4f11-a918-b072c969bfe2 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:34.821501 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7845c2-f259-4f11-a918-b072c969bfe2 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:34.822008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7845c2-f259-4f11-a918-b072c969bfe2 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:34.823599 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 69/138] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:34.828887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b279a-4ecb-405f-9975-b10f6f43cb28 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:34.829220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b279a-4ecb-405f-9975-b10f6f43cb28 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:34.829505 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b279a-4ecb-405f-9975-b10f6f43cb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:34.852900 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-d58b279a-4ecb-405f-9975-b10f6f43cb28 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:34.854102 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-d58b279a-4ecb-405f-9975-b10f6f43cb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:34.964898 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 70/139] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:35.004441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7845c2-f259-4f11-a918-b072c969bfe2 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:35.142275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7845c2-f259-4f11-a918-b072c969bfe2 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:35.176781 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613aa236-fd12-4c42-befd-1e888340e3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:35.177584 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613aa236-fd12-4c42-befd-1e888340e3ee None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:35.177873 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613aa236-fd12-4c42-befd-1e888340e3ee None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:35.178151 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613aa236-fd12-4c42-befd-1e888340e3ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:35.179334 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613aa236-fd12-4c42-befd-1e888340e3ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:35.180850 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613aa236-fd12-4c42-befd-1e888340e3ee None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:35.182908 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 70/140] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:52:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:35.188773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b279a-4ecb-405f-9975-b10f6f43cb28 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:35.341793 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf7d0c-d1fa-4dfa-881e-f5f33d9b97d4 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:35.342261 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf7d0c-d1fa-4dfa-881e-f5f33d9b97d4 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:35.342646 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf7d0c-d1fa-4dfa-881e-f5f33d9b97d4 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:35.344491 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 71/141] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:35.347085 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b279a-4ecb-405f-9975-b10f6f43cb28 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:35.350408 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6f2ab-d588-4b78-be46-7029dcd55ede None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:35.350810 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6f2ab-d588-4b78-be46-7029dcd55ede None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:35.351199 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6f2ab-d588-4b78-be46-7029dcd55ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:35.369450 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-81b6f2ab-d588-4b78-be46-7029dcd55ede None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:35.370798 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-81b6f2ab-d588-4b78-be46-7029dcd55ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:35.409569 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d32af-093d-4187-8d72-5b4b8fcdbef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:35.410169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d32af-093d-4187-8d72-5b4b8fcdbef5 None admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:35.410448 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d32af-093d-4187-8d72-5b4b8fcdbef5 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:35.410725 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d32af-093d-4187-8d72-5b4b8fcdbef5 None admin] PATH_INFO: `/v3/users` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:35.411439 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d32af-093d-4187-8d72-5b4b8fcdbef5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:35.412931 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d32af-093d-4187-8d72-5b4b8fcdbef5 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:35.442315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 72/142] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:52:35.466750 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6f2ab-d588-4b78-be46-7029dcd55ede None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:35.469051 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 71/143] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 12 16:52:35 2022] POST /identity/v3/users => generated 283 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:52:35.573984 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6f2ab-d588-4b78-be46-7029dcd55ede None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:35.613920 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42298ac0-8e7f-4f70-a13a-a924d5f7761a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:35.614741 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42298ac0-8e7f-4f70-a13a-a924d5f7761a None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:35.615026 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42298ac0-8e7f-4f70-a13a-a924d5f7761a None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:35.615363 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42298ac0-8e7f-4f70-a13a-a924d5f7761a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:35.629534 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42298ac0-8e7f-4f70-a13a-a924d5f7761a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:35.638118 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-42298ac0-8e7f-4f70-a13a-a924d5f7761a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:52:35.638118 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:35.638118 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:35.638118 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:35.638118 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:35.638118 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:35.638118 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:35.638118 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:35.638118 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:35.638118 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:35.638118 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:35.638118 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:35.638118 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:35.638118 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:35.638118 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:35.638118 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:35.638947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:35.638947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:35.638947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:35.638947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:35.638947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:35.638947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:35.638947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:35.638947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:35.638947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:35.638947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:35.638947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:35.638947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:52:35.638947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:35.638947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:35.638947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:35.638947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:35.640147 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:35.640147 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:35.640147 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:35.640147 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:35.640147 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:35.640147 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:35.640147 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:35.640147 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:35.640147 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:35.640147 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:35.640147 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:52:35.640147 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:52:35.643841 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 73/144] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:35.648788 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d32af-093d-4187-8d72-5b4b8fcdbef5 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:35.787683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d32af-093d-4187-8d72-5b4b8fcdbef5 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:35.826955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2731d-a421-4444-afac-27ee7623242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:35.827687 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2731d-a421-4444-afac-27ee7623242f None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:35.827977 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2731d-a421-4444-afac-27ee7623242f None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:35.828258 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2731d-a421-4444-afac-27ee7623242f None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:35.829063 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2731d-a421-4444-afac-27ee7623242f None admin] RBAC: Adding query filter params (name=reader) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:35.829963 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2731d-a421-4444-afac-27ee7623242f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:35.831409 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2731d-a421-4444-afac-27ee7623242f None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:35.840960 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 72/145] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:52:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:35.846704 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42298ac0-8e7f-4f70-a13a-a924d5f7761a None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:35.947808 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42298ac0-8e7f-4f70-a13a-a924d5f7761a None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:35.981066 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466a8c3-8be7-4afb-927b-59c7cc22b168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:35.981959 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466a8c3-8be7-4afb-927b-59c7cc22b168 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:35.982241 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466a8c3-8be7-4afb-927b-59c7cc22b168 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:35.982518 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466a8c3-8be7-4afb-927b-59c7cc22b168 None admin] PATH_INFO: `/v3/users/5ac3b057b1004c9a8134a5691db06b9d` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:35.983896 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466a8c3-8be7-4afb-927b-59c7cc22b168 None admin] RBAC: Authorizing `identity:get_user(user_id=5ac3b057b1004c9a8134a5691db06b9d)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:35.985913 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466a8c3-8be7-4afb-927b-59c7cc22b168 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:35.987696 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 74/146] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:35 2022] GET /identity/v3/users/5ac3b057b1004c9a8134a5691db06b9d => generated 289 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:35.993524 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2731d-a421-4444-afac-27ee7623242f None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:36.095370 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2731d-a421-4444-afac-27ee7623242f None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:36.129835 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0d683-29bd-4a88-b2b6-aff3b1c9a8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:36.130727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0d683-29bd-4a88-b2b6-aff3b1c9a8ee None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:36.131014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0d683-29bd-4a88-b2b6-aff3b1c9a8ee None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:36.131292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0d683-29bd-4a88-b2b6-aff3b1c9a8ee None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:36.132573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0d683-29bd-4a88-b2b6-aff3b1c9a8ee None admin] RBAC: Authorizing `identity:get_project(project_id=f86e7cbe28eb448b87b50a4d37dce199)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:36.134043 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0d683-29bd-4a88-b2b6-aff3b1c9a8ee None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:36.135795 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 73/147] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:35 2022] GET /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:36.141677 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466a8c3-8be7-4afb-927b-59c7cc22b168 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:36.245822 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466a8c3-8be7-4afb-927b-59c7cc22b168 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:36.279157 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172db38e-0c35-423f-979e-beeef1f39035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:36.280090 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172db38e-0c35-423f-979e-beeef1f39035 None admin] REQUEST_METHOD: `PUT` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:36.280378 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172db38e-0c35-423f-979e-beeef1f39035 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:36.280662 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172db38e-0c35-423f-979e-beeef1f39035 None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199/users/5ac3b057b1004c9a8134a5691db06b9d/roles/2088f05fbc394bb4a8b98c44c2af1309` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:36.283226 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172db38e-0c35-423f-979e-beeef1f39035 None admin] RBAC: Authorizing `identity:create_grant(project_id=f86e7cbe28eb448b87b50a4d37dce199, user_id=5ac3b057b1004c9a8134a5691db06b9d, role_id=2088f05fbc394bb4a8b98c44c2af1309)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:36.284735 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172db38e-0c35-423f-979e-beeef1f39035 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:36.320801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 75/148] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 12 16:52:36 2022] PUT /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199/users/5ac3b057b1004c9a8134a5691db06b9d/roles/2088f05fbc394bb4a8b98c44c2af1309 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:52:37.591764 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba981ba-1b2e-4977-8bdd-da07268e418f None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:37.592452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba981ba-1b2e-4977-8bdd-da07268e418f None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:37.592452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba981ba-1b2e-4977-8bdd-da07268e418f None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:37.593957 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 74/149] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:37.605660 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97621c-7305-43d4-bcb3-4ef880c61361 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:37.606232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97621c-7305-43d4-bcb3-4ef880c61361 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:37.606232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97621c-7305-43d4-bcb3-4ef880c61361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:37.632672 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-ac97621c-7305-43d4-bcb3-4ef880c61361 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:37.633879 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-ac97621c-7305-43d4-bcb3-4ef880c61361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:37.729029 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 76/150] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:37.773484 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba981ba-1b2e-4977-8bdd-da07268e418f None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:37.861918 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a8b5c-ba47-48de-8017-759704c7d840 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:37.862205 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a8b5c-ba47-48de-8017-759704c7d840 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:37.862387 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a8b5c-ba47-48de-8017-759704c7d840 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:37.863794 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 77/151] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:37.869025 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a025e86-85f5-4ae2-90e6-56241629ba78 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:37.869307 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a025e86-85f5-4ae2-90e6-56241629ba78 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:37.869584 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a025e86-85f5-4ae2-90e6-56241629ba78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:37.897389 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-5a025e86-85f5-4ae2-90e6-56241629ba78 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:37.898641 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-5a025e86-85f5-4ae2-90e6-56241629ba78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:37.914860 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba981ba-1b2e-4977-8bdd-da07268e418f None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:37.985909 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41814a-2e7e-42f0-bac9-0a25302ec3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:37.986725 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41814a-2e7e-42f0-bac9-0a25302ec3dd None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:37.987060 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41814a-2e7e-42f0-bac9-0a25302ec3dd None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:37.987341 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41814a-2e7e-42f0-bac9-0a25302ec3dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:38.007016 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41814a-2e7e-42f0-bac9-0a25302ec3dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:38.015188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-fb41814a-2e7e-42f0-bac9-0a25302ec3dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:52:38.015188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:38.015188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:38.015188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:38.015188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:38.015188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:38.015188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:38.015188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:38.015188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:38.015188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:38.015188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:38.015188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:38.015188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:38.015188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:38.015188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:38.015188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:38.016081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:38.016081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:38.016081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:38.016081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:38.016081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:38.016081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:38.016081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:38.016081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:38.016081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:38.016081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:38.016081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:38.016081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:52:38.016081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:38.016081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:38.016081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:38.016081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:38.016883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:38.016883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:38.016883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:38.016883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:38.016883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:38.016883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:38.016883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:38.016883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:38.016883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:38.016883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:38.016883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:52:38.016883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:52:38.020545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 75/152] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:52:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:38.026734 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41814a-2e7e-42f0-bac9-0a25302ec3dd None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:38.061397 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 78/153] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:52:38.118643 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a025e86-85f5-4ae2-90e6-56241629ba78 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:38.225285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41814a-2e7e-42f0-bac9-0a25302ec3dd None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:38.279005 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a025e86-85f5-4ae2-90e6-56241629ba78 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:38.293276 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fde37-33a6-42b9-bd0a-4b8c83760d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:38.293953 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fde37-33a6-42b9-bd0a-4b8c83760d66 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:38.294234 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fde37-33a6-42b9-bd0a-4b8c83760d66 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:38.294508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fde37-33a6-42b9-bd0a-4b8c83760d66 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:38.295351 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fde37-33a6-42b9-bd0a-4b8c83760d66 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:38.295554 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fde37-33a6-42b9-bd0a-4b8c83760d66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:38.297118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fde37-33a6-42b9-bd0a-4b8c83760d66 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:38.318886 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 76/154] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:52:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:38.318886 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df82578-f2c8-4254-bc3e-518e12b68e78 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:38.318886 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df82578-f2c8-4254-bc3e-518e12b68e78 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:38.318886 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df82578-f2c8-4254-bc3e-518e12b68e78 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:38.318886 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 77/155] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:38.324443 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e549e2-eab4-4d6a-8136-2f2937a95f29 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:38.324724 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e549e2-eab4-4d6a-8136-2f2937a95f29 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:38.325001 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e549e2-eab4-4d6a-8136-2f2937a95f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:38.344488 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca629c10-a666-4b76-9c82-8930cacef5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:38.346237 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca629c10-a666-4b76-9c82-8930cacef5ff None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:38.346761 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca629c10-a666-4b76-9c82-8930cacef5ff None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:38.347235 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca629c10-a666-4b76-9c82-8930cacef5ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:38.351342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-d9e549e2-eab4-4d6a-8136-2f2937a95f29 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:38.352887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-d9e549e2-eab4-4d6a-8136-2f2937a95f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:38.367223 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca629c10-a666-4b76-9c82-8930cacef5ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:38.375969 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-ca629c10-a666-4b76-9c82-8930cacef5ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:38.375969 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:38.375969 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:38.375969 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:38.375969 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:38.375969 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:38.375969 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:38.375969 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:38.375969 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:38.375969 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:38.375969 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:38.375969 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:38.375969 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:38.375969 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:38.375969 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:38.375969 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:38.376781 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:38.376781 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:38.376781 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:38.376781 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:38.376781 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:38.376781 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:38.376781 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:38.376781 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:38.376781 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:38.376781 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:38.376781 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:38.376781 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:52:38.376781 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:38.376781 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:38.376781 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:38.376781 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:38.377530 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:38.377530 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:38.377530 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:38.377530 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:38.377530 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:38.377530 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:38.377530 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:38.377530 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:38.377530 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:38.377530 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:38.377530 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:38.377530 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:52:38.380381 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 79/156] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:52:38.382397 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca629c10-a666-4b76-9c82-8930cacef5ff None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:38.468817 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 78/157] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:38.470867 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e549e2-eab4-4d6a-8136-2f2937a95f29 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:38.567364 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca629c10-a666-4b76-9c82-8930cacef5ff None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:38.616379 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea0933-83ae-47b4-afd9-afccb7827a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:38.617264 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea0933-83ae-47b4-afd9-afccb7827a32 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:38.617548 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea0933-83ae-47b4-afd9-afccb7827a32 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:38.617823 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea0933-83ae-47b4-afd9-afccb7827a32 None admin] PATH_INFO: `/v3/users/3e0ac53f471746699df5c834e91784f1` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:38.619021 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea0933-83ae-47b4-afd9-afccb7827a32 None admin] RBAC: Authorizing `identity:get_user(user_id=3e0ac53f471746699df5c834e91784f1)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:38.620525 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea0933-83ae-47b4-afd9-afccb7827a32 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:38.622152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 80/158] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:38 2022] GET /identity/v3/users/3e0ac53f471746699df5c834e91784f1 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:38.623469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3c3da-114f-433c-94b4-5b314ec44886 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:38.623725 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3c3da-114f-433c-94b4-5b314ec44886 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:38.624002 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3c3da-114f-433c-94b4-5b314ec44886 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:38.625465 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 81/159] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:38.626784 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3c3da-114f-433c-94b4-5b314ec44886 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:38.638188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e549e2-eab4-4d6a-8136-2f2937a95f29 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:38.691709 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2baef1-e420-4776-a03e-f151b678a046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:38.692440 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2baef1-e420-4776-a03e-f151b678a046 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:38.692720 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2baef1-e420-4776-a03e-f151b678a046 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:38.692999 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2baef1-e420-4776-a03e-f151b678a046 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:38.693800 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2baef1-e420-4776-a03e-f151b678a046 None admin] RBAC: Adding query filter params (name=member) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:38.694104 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2baef1-e420-4776-a03e-f151b678a046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:38.695550 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2baef1-e420-4776-a03e-f151b678a046 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:38.711236 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 79/160] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:52:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:38.712099 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2baef1-e420-4776-a03e-f151b678a046 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:38.731854 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3c3da-114f-433c-94b4-5b314ec44886 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:38.777003 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a08f31-e103-40fd-88a6-b2fcc7bd2bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:38.777911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a08f31-e103-40fd-88a6-b2fcc7bd2bbd None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:38.778264 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a08f31-e103-40fd-88a6-b2fcc7bd2bbd None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:38.778542 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a08f31-e103-40fd-88a6-b2fcc7bd2bbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:38.794868 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a08f31-e103-40fd-88a6-b2fcc7bd2bbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:38.808540 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-13a08f31-e103-40fd-88a6-b2fcc7bd2bbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:52:38.808540 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:38.808540 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:38.808540 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:38.808540 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:38.808540 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:38.808540 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:38.808540 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:38.808540 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:38.808540 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:38.808540 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:38.808540 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:38.808540 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:38.808540 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:38.808540 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:38.808540 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:38.810968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:38.810968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:38.810968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:38.810968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:38.810968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:38.810968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:38.810968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:38.810968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:38.810968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:38.810968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:38.810968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:38.810968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:52:38.810968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:38.810968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:38.810968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:38.810968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:38.813084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:38.813084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:38.813084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:38.813084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:38.813084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:38.813084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:38.813084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:38.813084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:38.813084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:38.813084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:38.813084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:52:38.813084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:52:38.813084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 82/161] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 12 16:52:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:38.813084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e680da-2c16-435e-b4b1-78b09b7e4f52 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:38.819146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e680da-2c16-435e-b4b1-78b09b7e4f52 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:38.819146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e680da-2c16-435e-b4b1-78b09b7e4f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:38.840551 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-12e680da-2c16-435e-b4b1-78b09b7e4f52 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:38.841749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-12e680da-2c16-435e-b4b1-78b09b7e4f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:38.889003 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2baef1-e420-4776-a03e-f151b678a046 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:38.951113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7c1bf-e266-4fea-b1ad-adece884af16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:38.951814 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7c1bf-e266-4fea-b1ad-adece884af16 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:38.952099 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7c1bf-e266-4fea-b1ad-adece884af16 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:38.952374 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e7c1bf-e266-4fea-b1ad-adece884af16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:39.026500 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7c1bf-e266-4fea-b1ad-adece884af16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:39.028000 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e7c1bf-e266-4fea-b1ad-adece884af16 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:39.058437 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 83/162] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:39.059786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e680da-2c16-435e-b4b1-78b09b7e4f52 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:39.126913 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 80/163] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:52:39.127584 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7c1bf-e266-4fea-b1ad-adece884af16 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:39.214696 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e680da-2c16-435e-b4b1-78b09b7e4f52 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:39.224818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e7c1bf-e266-4fea-b1ad-adece884af16 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:39.263876 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90fb06-aa41-46d2-8066-a5a024546489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:39.264555 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90fb06-aa41-46d2-8066-a5a024546489 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:39.264835 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90fb06-aa41-46d2-8066-a5a024546489 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:39.265108 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90fb06-aa41-46d2-8066-a5a024546489 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:39.265856 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90fb06-aa41-46d2-8066-a5a024546489 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:39.266158 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90fb06-aa41-46d2-8066-a5a024546489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:39.270508 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950a96c-2d38-49b5-b76d-5b34ef00437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:39.271405 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950a96c-2d38-49b5-b76d-5b34ef00437d None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:39.271698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950a96c-2d38-49b5-b76d-5b34ef00437d None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:39.271973 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950a96c-2d38-49b5-b76d-5b34ef00437d None admin] PATH_INFO: `/v3/users/3e0ac53f471746699df5c834e91784f1` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:39.272948 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90fb06-aa41-46d2-8066-a5a024546489 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:39.275344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950a96c-2d38-49b5-b76d-5b34ef00437d None admin] RBAC: Authorizing `identity:get_user(user_id=3e0ac53f471746699df5c834e91784f1)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:39.276855 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950a96c-2d38-49b5-b76d-5b34ef00437d None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:39.283468 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 84/164] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:39 2022] GET /identity/v3/users/3e0ac53f471746699df5c834e91784f1 => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:39.284436 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950a96c-2d38-49b5-b76d-5b34ef00437d None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:39.290096 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 81/165] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:39.290931 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90fb06-aa41-46d2-8066-a5a024546489 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:39.421954 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950a96c-2d38-49b5-b76d-5b34ef00437d None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:39.450827 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90fb06-aa41-46d2-8066-a5a024546489 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:39.460831 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940612e-2f75-455a-93be-8898bbf98e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:39.461629 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940612e-2f75-455a-93be-8898bbf98e87 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:39.461906 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940612e-2f75-455a-93be-8898bbf98e87 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:39.462174 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940612e-2f75-455a-93be-8898bbf98e87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:39.481087 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940612e-2f75-455a-93be-8898bbf98e87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:39.488878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-e940612e-2f75-455a-93be-8898bbf98e87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:39.488878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:39.488878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:39.488878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:39.488878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:39.488878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:39.488878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:39.488878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:39.488878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:39.488878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:39.488878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:39.488878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:39.488878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:39.488878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:39.488878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:39.488878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:39.489764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:39.489764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:39.489764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:39.489764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:39.489764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:39.489764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:39.489764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:39.489764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:39.489764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:39.489764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:39.489764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:39.489764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:52:39.489764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:39.489764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:39.489764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:39.489764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:39.491334 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:39.491334 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:39.491334 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:39.491334 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:39.491334 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:39.491334 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:39.491334 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:39.491334 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:39.491334 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:39.491334 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:39.491334 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:39.491334 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:52:39.491334 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 85/166] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:39.491334 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940612e-2f75-455a-93be-8898bbf98e87 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:39.493166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697c3e7-75d0-4d62-822c-6fe180c38434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:39.493166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697c3e7-75d0-4d62-822c-6fe180c38434 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:39.493166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697c3e7-75d0-4d62-822c-6fe180c38434 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:39.493166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697c3e7-75d0-4d62-822c-6fe180c38434 None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:39.493735 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697c3e7-75d0-4d62-822c-6fe180c38434 None admin] RBAC: Authorizing `identity:get_project(project_id=f86e7cbe28eb448b87b50a4d37dce199)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:39.495136 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697c3e7-75d0-4d62-822c-6fe180c38434 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:39.496860 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 82/167] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:39 2022] GET /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:39.497624 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697c3e7-75d0-4d62-822c-6fe180c38434 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:39.674971 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697c3e7-75d0-4d62-822c-6fe180c38434 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:39.683109 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940612e-2f75-455a-93be-8898bbf98e87 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:39.720524 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f174c-bbdd-4750-86b5-f1dd9f4a4b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:39.721403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f174c-bbdd-4750-86b5-f1dd9f4a4b52 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:39.721678 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f174c-bbdd-4750-86b5-f1dd9f4a4b52 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:39.721946 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f174c-bbdd-4750-86b5-f1dd9f4a4b52 None admin] PATH_INFO: `/v3/users/bbf536e8106349f196ff7b89dc343a4a` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:39.723138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f174c-bbdd-4750-86b5-f1dd9f4a4b52 None admin] RBAC: Authorizing `identity:get_user(user_id=bbf536e8106349f196ff7b89dc343a4a)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:39.724873 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f174c-bbdd-4750-86b5-f1dd9f4a4b52 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:39.726976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 83/168] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:39 2022] GET /identity/v3/users/bbf536e8106349f196ff7b89dc343a4a => generated 247 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:39.727521 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f174c-bbdd-4750-86b5-f1dd9f4a4b52 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:39.756961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ce8f4-df1b-4dc3-a042-75e1a8037476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:39.757547 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ce8f4-df1b-4dc3-a042-75e1a8037476 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:39.757826 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ce8f4-df1b-4dc3-a042-75e1a8037476 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:39.758094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ce8f4-df1b-4dc3-a042-75e1a8037476 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:39.852180 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ce8f4-df1b-4dc3-a042-75e1a8037476 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:39.853930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ce8f4-df1b-4dc3-a042-75e1a8037476 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:39.959883 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 86/169] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:52:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:52:39.960556 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ce8f4-df1b-4dc3-a042-75e1a8037476 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:39.967770 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f174c-bbdd-4750-86b5-f1dd9f4a4b52 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:40.019949 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa7988-38c0-4709-b1fa-e1ca85336cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:40.020522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa7988-38c0-4709-b1fa-e1ca85336cff None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:40.020804 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa7988-38c0-4709-b1fa-e1ca85336cff None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:40.021080 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa7988-38c0-4709-b1fa-e1ca85336cff None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:40.021828 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa7988-38c0-4709-b1fa-e1ca85336cff None admin] RBAC: Adding query filter params (name=member) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:40.022133 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa7988-38c0-4709-b1fa-e1ca85336cff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:40.023526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa7988-38c0-4709-b1fa-e1ca85336cff None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:40.032741 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 84/170] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:52:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:40.034144 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa7988-38c0-4709-b1fa-e1ca85336cff None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:40.059400 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ce8f4-df1b-4dc3-a042-75e1a8037476 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:40.093065 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7293574-d9fc-4495-b865-b3885fe417c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:40.093763 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7293574-d9fc-4495-b865-b3885fe417c7 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:40.093973 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7293574-d9fc-4495-b865-b3885fe417c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:40.094239 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7293574-d9fc-4495-b865-b3885fe417c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:40.095618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7293574-d9fc-4495-b865-b3885fe417c7 None admin] RBAC: Adding query filter params (role.id=f45adb34d54d49558694df72aec6b99d, scope.project.id=f86e7cbe28eb448b87b50a4d37dce199, user.id=3e0ac53f471746699df5c834e91784f1) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:40.095952 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7293574-d9fc-4495-b865-b3885fe417c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:40.097571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7293574-d9fc-4495-b865-b3885fe417c7 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:40.103840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 87/171] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:52:39 2022] GET /identity/v3/role_assignments?user.id=3e0ac53f471746699df5c834e91784f1&scope.project.id=f86e7cbe28eb448b87b50a4d37dce199&role.id=f45adb34d54d49558694df72aec6b99d => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:40.104648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7293574-d9fc-4495-b865-b3885fe417c7 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:40.143971 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa7988-38c0-4709-b1fa-e1ca85336cff None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:40.184471 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e51d86-efaa-440c-a7a6-0329040955a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:40.185148 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51d86-efaa-440c-a7a6-0329040955a1 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:40.185432 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51d86-efaa-440c-a7a6-0329040955a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:40.185938 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e51d86-efaa-440c-a7a6-0329040955a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:40.207435 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7293574-d9fc-4495-b865-b3885fe417c7 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:40.258884 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e8640-338d-4ca8-99bb-5e43fd3d764e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:40.259808 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e8640-338d-4ca8-99bb-5e43fd3d764e None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:40.260067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e8640-338d-4ca8-99bb-5e43fd3d764e None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:40.260332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e8640-338d-4ca8-99bb-5e43fd3d764e None admin] PATH_INFO: `/v3/projects/7ffaaac54a994dbfa9e9bc89600c2fd9` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:40.261786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e8640-338d-4ca8-99bb-5e43fd3d764e None admin] RBAC: Authorizing `identity:get_project(project_id=7ffaaac54a994dbfa9e9bc89600c2fd9)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:40.263261 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e8640-338d-4ca8-99bb-5e43fd3d764e None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:40.265279 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 88/172] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:40 2022] GET /identity/v3/projects/7ffaaac54a994dbfa9e9bc89600c2fd9 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:40.268160 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e8640-338d-4ca8-99bb-5e43fd3d764e None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:40.329267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e51d86-efaa-440c-a7a6-0329040955a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:40.330683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e51d86-efaa-440c-a7a6-0329040955a1 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:40.465501 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e8640-338d-4ca8-99bb-5e43fd3d764e None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:40.506114 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 85/173] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:52:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:52:40.507473 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8eacb-9f3c-499f-8176-2eef3aafbd70 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:40.507835 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8eacb-9f3c-499f-8176-2eef3aafbd70 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:40.508167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8eacb-9f3c-499f-8176-2eef3aafbd70 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:40.509804 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 86/174] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:40.509995 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709db9ec-37c4-45be-b6eb-8983b8cc5d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:40.510646 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709db9ec-37c4-45be-b6eb-8983b8cc5d4c None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:40.511004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709db9ec-37c4-45be-b6eb-8983b8cc5d4c None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:40.511160 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709db9ec-37c4-45be-b6eb-8983b8cc5d4c None admin] PATH_INFO: `/v3/users/3e0ac53f471746699df5c834e91784f1` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:40.514681 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709db9ec-37c4-45be-b6eb-8983b8cc5d4c None admin] RBAC: Authorizing `identity:get_user(user_id=3e0ac53f471746699df5c834e91784f1)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:40.514878 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8eacb-9f3c-499f-8176-2eef3aafbd70 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:40.516202 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709db9ec-37c4-45be-b6eb-8983b8cc5d4c None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:40.518553 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 89/175] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:40 2022] GET /identity/v3/users/3e0ac53f471746699df5c834e91784f1 => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:40.519590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf5aea-6a67-4a32-b68b-ea2022c83b0c None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:40.519870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf5aea-6a67-4a32-b68b-ea2022c83b0c None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:40.520153 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf5aea-6a67-4a32-b68b-ea2022c83b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:40.542116 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-6dbf5aea-6a67-4a32-b68b-ea2022c83b0c None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:40.543295 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-6dbf5aea-6a67-4a32-b68b-ea2022c83b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:40.613281 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 90/176] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:40.614187 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf5aea-6a67-4a32-b68b-ea2022c83b0c None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:40.623595 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8eacb-9f3c-499f-8176-2eef3aafbd70 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:40.661267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557ee7a-ddc9-4703-98d8-8117229961b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:40.661932 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557ee7a-ddc9-4703-98d8-8117229961b9 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:40.662209 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557ee7a-ddc9-4703-98d8-8117229961b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:40.662486 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557ee7a-ddc9-4703-98d8-8117229961b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:40.663321 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557ee7a-ddc9-4703-98d8-8117229961b9 None admin] RBAC: Adding query filter params (role.id=0474b158b4bc4046ac169d53fff04721, scope.project.id=7ffaaac54a994dbfa9e9bc89600c2fd9, user.id=3e0ac53f471746699df5c834e91784f1) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:40.663654 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557ee7a-ddc9-4703-98d8-8117229961b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:40.665135 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557ee7a-ddc9-4703-98d8-8117229961b9 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:40.671419 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 87/177] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:52:40 2022] GET /identity/v3/role_assignments?user.id=3e0ac53f471746699df5c834e91784f1&scope.project.id=7ffaaac54a994dbfa9e9bc89600c2fd9&role.id=0474b158b4bc4046ac169d53fff04721 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:40.672290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557ee7a-ddc9-4703-98d8-8117229961b9 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:40.722276 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf5aea-6a67-4a32-b68b-ea2022c83b0c None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:40.760508 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037a330-764d-4624-ae7b-0c1747540c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:40.761433 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037a330-764d-4624-ae7b-0c1747540c94 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:40.761709 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037a330-764d-4624-ae7b-0c1747540c94 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:40.762049 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037a330-764d-4624-ae7b-0c1747540c94 None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:40.763251 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037a330-764d-4624-ae7b-0c1747540c94 None admin] RBAC: Authorizing `identity:get_project(project_id=f86e7cbe28eb448b87b50a4d37dce199)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:40.764972 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d037a330-764d-4624-ae7b-0c1747540c94 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:40.767343 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 91/178] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:40 2022] GET /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:40.768210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037a330-764d-4624-ae7b-0c1747540c94 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:40.787348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557ee7a-ddc9-4703-98d8-8117229961b9 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:40.824131 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655893e5-2ea2-451c-bf90-d2619a7aa97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:40.824777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655893e5-2ea2-451c-bf90-d2619a7aa97b None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:40.825054 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655893e5-2ea2-451c-bf90-d2619a7aa97b None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:40.825326 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655893e5-2ea2-451c-bf90-d2619a7aa97b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:40.878362 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037a330-764d-4624-ae7b-0c1747540c94 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:40.904163 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655893e5-2ea2-451c-bf90-d2619a7aa97b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:40.908854 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655893e5-2ea2-451c-bf90-d2619a7aa97b None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:40.919769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54838d9-2453-4ccd-96a7-d0f7a89491eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:40.920132 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54838d9-2453-4ccd-96a7-d0f7a89491eb None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:40.920132 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54838d9-2453-4ccd-96a7-d0f7a89491eb None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:40.920424 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54838d9-2453-4ccd-96a7-d0f7a89491eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:40.932280 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54838d9-2453-4ccd-96a7-d0f7a89491eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:40.940703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-b54838d9-2453-4ccd-96a7-d0f7a89491eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:52:40.940703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:40.940703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:40.940703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:40.940703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:40.940703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:40.940703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:40.940703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:40.940703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:40.940703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:40.940703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:40.940703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:40.940703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:40.940703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:40.940703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:40.940703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:40.941648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:40.941648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:40.941648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:40.941648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:40.941648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:40.941648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:40.941648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:40.941648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:40.941648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:40.941648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:40.941648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:40.941648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:52:40.941648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:40.941648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:40.941648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:40.941648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:40.942839 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:40.942839 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:40.942839 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:40.942839 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:40.942839 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:40.942839 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:40.942839 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:40.942839 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:40.942839 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:40.942839 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:40.942839 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:52:40.942839 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:52:40.942839 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 92/179] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 12 16:52:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:40.943724 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aea074-df49-47f0-89d7-1744a3de0de8 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:40.943724 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aea074-df49-47f0-89d7-1744a3de0de8 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:40.943724 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aea074-df49-47f0-89d7-1744a3de0de8 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:40.944998 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 93/180] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:40.945706 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aea074-df49-47f0-89d7-1744a3de0de8 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:41.020429 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 88/181] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:52:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:52:41.021840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae996272-81e1-412c-8cd2-142f4099d558 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:41.022130 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae996272-81e1-412c-8cd2-142f4099d558 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:41.022407 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae996272-81e1-412c-8cd2-142f4099d558 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:41.024132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 89/182] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:41.024945 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae996272-81e1-412c-8cd2-142f4099d558 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:41.082897 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aea074-df49-47f0-89d7-1744a3de0de8 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:41.117544 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308186d-892d-43c6-8389-eefacd2e026c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:41.118206 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308186d-892d-43c6-8389-eefacd2e026c None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:41.118487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308186d-892d-43c6-8389-eefacd2e026c None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:41.118763 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308186d-892d-43c6-8389-eefacd2e026c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:41.119602 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308186d-892d-43c6-8389-eefacd2e026c None admin] RBAC: Adding query filter params (role.id=fbd6364b42a641f695c0b265a789057a, scope.project.id=f86e7cbe28eb448b87b50a4d37dce199, user.id=bbf536e8106349f196ff7b89dc343a4a) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:41.119943 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308186d-892d-43c6-8389-eefacd2e026c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:41.121414 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308186d-892d-43c6-8389-eefacd2e026c None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:41.135995 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 94/183] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:52:40 2022] GET /identity/v3/role_assignments?user.id=bbf536e8106349f196ff7b89dc343a4a&scope.project.id=f86e7cbe28eb448b87b50a4d37dce199&role.id=fbd6364b42a641f695c0b265a789057a => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:41.135995 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a1afb-21b6-4ce4-82fa-59c48bea4986 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:41.135995 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a1afb-21b6-4ce4-82fa-59c48bea4986 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:41.135995 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a1afb-21b6-4ce4-82fa-59c48bea4986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:41.142761 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae996272-81e1-412c-8cd2-142f4099d558 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:41.148478 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-7d3a1afb-21b6-4ce4-82fa-59c48bea4986 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:41.149839 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-7d3a1afb-21b6-4ce4-82fa-59c48bea4986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:41.191298 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d94ca-e7ef-4177-bcd6-a490cfa5e6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:41.192044 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d94ca-e7ef-4177-bcd6-a490cfa5e6d4 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:41.192533 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d94ca-e7ef-4177-bcd6-a490cfa5e6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:41.192806 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d94ca-e7ef-4177-bcd6-a490cfa5e6d4 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:41.194532 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d94ca-e7ef-4177-bcd6-a490cfa5e6d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:41.194841 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d94ca-e7ef-4177-bcd6-a490cfa5e6d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:41.196314 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d94ca-e7ef-4177-bcd6-a490cfa5e6d4 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:41.208802 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 90/184] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:41.209805 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d94ca-e7ef-4177-bcd6-a490cfa5e6d4 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:41.237871 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 95/185] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:41.245623 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144e999-1f56-4831-800c-4214136f8b5b None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:41.246261 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144e999-1f56-4831-800c-4214136f8b5b None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:41.246544 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144e999-1f56-4831-800c-4214136f8b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:41.266799 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-8144e999-1f56-4831-800c-4214136f8b5b None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:41.268064 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-8144e999-1f56-4831-800c-4214136f8b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:41.323397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d94ca-e7ef-4177-bcd6-a490cfa5e6d4 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:41.342348 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 96/186] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:41.342348 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144e999-1f56-4831-800c-4214136f8b5b None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:41.360668 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d845d95-b224-44ec-991d-1c983662cc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:41.361847 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d845d95-b224-44ec-991d-1c983662cc66 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:41.362351 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d845d95-b224-44ec-991d-1c983662cc66 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:41.362830 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d845d95-b224-44ec-991d-1c983662cc66 None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:41.364284 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d845d95-b224-44ec-991d-1c983662cc66 None admin] RBAC: Authorizing `identity:get_project(project_id=f86e7cbe28eb448b87b50a4d37dce199)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:41.365949 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d845d95-b224-44ec-991d-1c983662cc66 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:41.367922 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 91/187] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:41 2022] GET /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:41.369357 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca26185-4a14-4d98-b763-363acede55ba None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:41.369851 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca26185-4a14-4d98-b763-363acede55ba None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:41.370138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca26185-4a14-4d98-b763-363acede55ba None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:41.371525 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 92/188] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:41.372163 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca26185-4a14-4d98-b763-363acede55ba None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:41.450310 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144e999-1f56-4831-800c-4214136f8b5b None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:41.476535 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca26185-4a14-4d98-b763-363acede55ba None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:41.489066 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270f308-5566-4f41-b066-f634237f95bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:41.489938 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270f308-5566-4f41-b066-f634237f95bf None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:41.490220 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270f308-5566-4f41-b066-f634237f95bf None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:41.490496 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270f308-5566-4f41-b066-f634237f95bf None admin] PATH_INFO: `/v3/users/da8e87c60a3b4d469944ab4c39032da7` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:41.504319 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270f308-5566-4f41-b066-f634237f95bf None admin] RBAC: Authorizing `identity:get_user(user_id=da8e87c60a3b4d469944ab4c39032da7)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:41.505793 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270f308-5566-4f41-b066-f634237f95bf None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:41.507439 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 97/189] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:41 2022] GET /identity/v3/users/da8e87c60a3b4d469944ab4c39032da7 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:41.509119 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4001d7-b8c8-4182-8aca-9958edcaf0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:41.509605 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270f308-5566-4f41-b066-f634237f95bf None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:41.509957 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4001d7-b8c8-4182-8aca-9958edcaf0cb None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:41.510186 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4001d7-b8c8-4182-8aca-9958edcaf0cb None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:41.510457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4001d7-b8c8-4182-8aca-9958edcaf0cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:41.521199 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4001d7-b8c8-4182-8aca-9958edcaf0cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:41.529297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-6b4001d7-b8c8-4182-8aca-9958edcaf0cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:52:41.529297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:41.529297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:41.529297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:41.529297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:41.529297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:41.529297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:41.529297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:41.529297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:41.529297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:41.529297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:41.529297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:41.529297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:41.529297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:41.529297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:41.529297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:41.530274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:41.530274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:41.530274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:41.530274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:41.530274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:41.530274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:41.530274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:41.530274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:41.530274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:41.530274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:41.530274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:41.530274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:52:41.530274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:41.530274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:41.530274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:41.530274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:41.536452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:41.536452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:41.536452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:41.536452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:41.536452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:41.536452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:41.536452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:41.536452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:41.536452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:41.536452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:41.536452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:52:41.536452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:52:41.536452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 93/190] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:52:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:41.536452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390814f-71ac-4f4a-8935-b972a0e98e6f None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:41.537341 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390814f-71ac-4f4a-8935-b972a0e98e6f None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:41.537341 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390814f-71ac-4f4a-8935-b972a0e98e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:41.550263 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-c390814f-71ac-4f4a-8935-b972a0e98e6f None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:41.551430 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-c390814f-71ac-4f4a-8935-b972a0e98e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:41.604293 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270f308-5566-4f41-b066-f634237f95bf None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:41.612854 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 94/191] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:41.613664 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390814f-71ac-4f4a-8935-b972a0e98e6f None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:41.637703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a5175-744b-40bc-b754-7b044cad5e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:41.638494 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a5175-744b-40bc-b754-7b044cad5e22 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:41.638777 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a5175-744b-40bc-b754-7b044cad5e22 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:41.639057 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a5175-744b-40bc-b754-7b044cad5e22 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:41.649405 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a5175-744b-40bc-b754-7b044cad5e22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:41.657146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-284a5175-744b-40bc-b754-7b044cad5e22 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:52:41.657146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:41.657146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:41.657146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:41.657146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:41.657146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:41.657146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:41.657146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:41.657146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:41.657146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:41.657146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:41.657146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:41.657146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:41.657146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:41.657146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:41.657146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:41.658156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:41.658156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:41.658156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:41.658156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:41.658156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:41.658156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:41.658156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:41.658156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:41.658156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:41.658156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:41.658156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:41.658156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:52:41.658156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:41.658156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:41.658156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:41.658156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:41.659096 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:41.659096 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:41.659096 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:41.659096 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:41.659096 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:41.659096 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:41.659096 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:41.659096 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:41.659096 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:41.659096 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:41.659096 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:52:41.659096 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:52:41.659096 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 98/192] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:41.659096 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a5175-744b-40bc-b754-7b044cad5e22 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:41.711875 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390814f-71ac-4f4a-8935-b972a0e98e6f None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:41.743130 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484a9d9-4613-4963-92f1-ce9a73e6ff0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:41.743811 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484a9d9-4613-4963-92f1-ce9a73e6ff0f None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:41.744088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484a9d9-4613-4963-92f1-ce9a73e6ff0f None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:41.744358 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484a9d9-4613-4963-92f1-ce9a73e6ff0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:41.745173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484a9d9-4613-4963-92f1-ce9a73e6ff0f None admin] RBAC: Adding query filter params (role.id=0474b158b4bc4046ac169d53fff04721, scope.project.id=f86e7cbe28eb448b87b50a4d37dce199, user.id=3e0ac53f471746699df5c834e91784f1) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:41.745478 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484a9d9-4613-4963-92f1-ce9a73e6ff0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:41.746913 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484a9d9-4613-4963-92f1-ce9a73e6ff0f None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:41.752365 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a5175-744b-40bc-b754-7b044cad5e22 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:41.752968 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 95/193] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:52:41 2022] GET /identity/v3/role_assignments?user.id=3e0ac53f471746699df5c834e91784f1&scope.project.id=f86e7cbe28eb448b87b50a4d37dce199&role.id=0474b158b4bc4046ac169d53fff04721 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:41.753785 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484a9d9-4613-4963-92f1-ce9a73e6ff0f None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:41.788290 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb5e1e-cbec-4a04-9f26-02e0502c1d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:41.788972 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb5e1e-cbec-4a04-9f26-02e0502c1d53 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:41.789311 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb5e1e-cbec-4a04-9f26-02e0502c1d53 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:41.789590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb5e1e-cbec-4a04-9f26-02e0502c1d53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:41.857463 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484a9d9-4613-4963-92f1-ce9a73e6ff0f None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:41.861137 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb5e1e-cbec-4a04-9f26-02e0502c1d53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:41.862659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb5e1e-cbec-4a04-9f26-02e0502c1d53 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:41.893446 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa3d1f-1bbd-4998-b6d0-9a05cf37dda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:41.894529 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa3d1f-1bbd-4998-b6d0-9a05cf37dda0 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:41.894948 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa3d1f-1bbd-4998-b6d0-9a05cf37dda0 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:41.895359 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa3d1f-1bbd-4998-b6d0-9a05cf37dda0 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:41.896291 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa3d1f-1bbd-4998-b6d0-9a05cf37dda0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:41.896732 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa3d1f-1bbd-4998-b6d0-9a05cf37dda0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:41.898323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa3d1f-1bbd-4998-b6d0-9a05cf37dda0 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:41.912947 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 96/194] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:52:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:41.912947 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa3d1f-1bbd-4998-b6d0-9a05cf37dda0 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:41.969870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 99/195] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:52:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:52:41.971124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb5e1e-cbec-4a04-9f26-02e0502c1d53 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:42.021270 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa3d1f-1bbd-4998-b6d0-9a05cf37dda0 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:42.059961 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb67e9-162a-4218-88df-7e575952ee8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:42.060929 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb67e9-162a-4218-88df-7e575952ee8f None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:42.061214 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb67e9-162a-4218-88df-7e575952ee8f None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:42.061492 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb67e9-162a-4218-88df-7e575952ee8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:42.062676 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb67e9-162a-4218-88df-7e575952ee8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:42.064717 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb67e9-162a-4218-88df-7e575952ee8f None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:42.066342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 97/196] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:52:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:42.067117 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb67e9-162a-4218-88df-7e575952ee8f None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:42.067559 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb5e1e-cbec-4a04-9f26-02e0502c1d53 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:42.099211 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f10d8a-2994-4ad3-b556-0c8684623065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:42.099972 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f10d8a-2994-4ad3-b556-0c8684623065 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:42.100256 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f10d8a-2994-4ad3-b556-0c8684623065 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:42.100531 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f10d8a-2994-4ad3-b556-0c8684623065 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:42.101278 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f10d8a-2994-4ad3-b556-0c8684623065 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:42.101829 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f10d8a-2994-4ad3-b556-0c8684623065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:42.103215 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f10d8a-2994-4ad3-b556-0c8684623065 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:42.111577 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 100/197] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:52:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:42.112389 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f10d8a-2994-4ad3-b556-0c8684623065 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:42.161255 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb67e9-162a-4218-88df-7e575952ee8f None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:42.193305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf27d6-7f96-45de-85f8-8f5302735d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:42.194172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf27d6-7f96-45de-85f8-8f5302735d0a None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:42.194453 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf27d6-7f96-45de-85f8-8f5302735d0a None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:42.194727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf27d6-7f96-45de-85f8-8f5302735d0a None admin] PATH_INFO: `/v3/users/da8e87c60a3b4d469944ab4c39032da7` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:42.195950 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf27d6-7f96-45de-85f8-8f5302735d0a None admin] RBAC: Authorizing `identity:get_user(user_id=da8e87c60a3b4d469944ab4c39032da7)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:42.197398 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf27d6-7f96-45de-85f8-8f5302735d0a None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:42.199019 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 98/198] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:42 2022] GET /identity/v3/users/da8e87c60a3b4d469944ab4c39032da7 => generated 283 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:42.199795 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf27d6-7f96-45de-85f8-8f5302735d0a None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:42.205038 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f10d8a-2994-4ad3-b556-0c8684623065 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:42.237642 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0f27a-90c4-42d6-8b0a-98301da141bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:42.238420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0f27a-90c4-42d6-8b0a-98301da141bb None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:42.238708 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0f27a-90c4-42d6-8b0a-98301da141bb None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:42.238984 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0f27a-90c4-42d6-8b0a-98301da141bb None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:42.240197 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0f27a-90c4-42d6-8b0a-98301da141bb None admin] RBAC: Authorizing `identity:get_project(project_id=7de1a1d5d5f041ddbc5231b5975a3a68)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:42.241661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0f27a-90c4-42d6-8b0a-98301da141bb None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:42.243530 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 101/199] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:42 2022] GET /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68 => generated 302 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:42.244138 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0f27a-90c4-42d6-8b0a-98301da141bb None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:42.293113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf27d6-7f96-45de-85f8-8f5302735d0a None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:42.324605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a0bc5-8a01-4b4a-badd-3c50a709372b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:42.325266 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a0bc5-8a01-4b4a-badd-3c50a709372b None admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:42.325548 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a0bc5-8a01-4b4a-badd-3c50a709372b None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:42.325818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a0bc5-8a01-4b4a-badd-3c50a709372b None admin] PATH_INFO: `/v3/users` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:42.326518 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a0bc5-8a01-4b4a-badd-3c50a709372b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:42.327990 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a0bc5-8a01-4b4a-badd-3c50a709372b None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:42.341658 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0f27a-90c4-42d6-8b0a-98301da141bb None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:42.346820 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 99/200] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 12 16:52:42 2022] POST /identity/v3/users => generated 297 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:52:42.347456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a0bc5-8a01-4b4a-badd-3c50a709372b None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:42.379736 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18859fa7-5bb7-4133-90e8-ee8ed658012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:42.381599 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18859fa7-5bb7-4133-90e8-ee8ed658012c None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:42.382419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18859fa7-5bb7-4133-90e8-ee8ed658012c None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:42.382905 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18859fa7-5bb7-4133-90e8-ee8ed658012c None admin] PATH_INFO: `/v3/users/5ac3b057b1004c9a8134a5691db06b9d` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:42.385318 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18859fa7-5bb7-4133-90e8-ee8ed658012c None admin] RBAC: Authorizing `identity:get_user(user_id=5ac3b057b1004c9a8134a5691db06b9d)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:42.387829 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18859fa7-5bb7-4133-90e8-ee8ed658012c None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:42.390370 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 102/201] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:42 2022] GET /identity/v3/users/5ac3b057b1004c9a8134a5691db06b9d => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:42.392363 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18859fa7-5bb7-4133-90e8-ee8ed658012c None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:42.463431 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a0bc5-8a01-4b4a-badd-3c50a709372b None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:42.504511 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7cfcd-5c92-41f9-a521-ee69b6d8a3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:42.505128 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7cfcd-5c92-41f9-a521-ee69b6d8a3ca None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:42.505406 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7cfcd-5c92-41f9-a521-ee69b6d8a3ca None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:42.505684 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7cfcd-5c92-41f9-a521-ee69b6d8a3ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:42.518320 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18859fa7-5bb7-4133-90e8-ee8ed658012c None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:42.558004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28a661-9c6b-40a3-afc3-6831d8f31186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:42.558664 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28a661-9c6b-40a3-afc3-6831d8f31186 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:42.558945 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28a661-9c6b-40a3-afc3-6831d8f31186 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:42.559221 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28a661-9c6b-40a3-afc3-6831d8f31186 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:42.560074 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28a661-9c6b-40a3-afc3-6831d8f31186 None admin] RBAC: Adding query filter params (role.id=fbd6364b42a641f695c0b265a789057a, scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68, user.id=da8e87c60a3b4d469944ab4c39032da7) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:42.560384 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28a661-9c6b-40a3-afc3-6831d8f31186 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:42.561854 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28a661-9c6b-40a3-afc3-6831d8f31186 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:42.567978 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 103/202] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:52:42 2022] GET /identity/v3/role_assignments?user.id=da8e87c60a3b4d469944ab4c39032da7&scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68&role.id=fbd6364b42a641f695c0b265a789057a => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:42.568628 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28a661-9c6b-40a3-afc3-6831d8f31186 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:42.583697 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7cfcd-5c92-41f9-a521-ee69b6d8a3ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:42.585215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7cfcd-5c92-41f9-a521-ee69b6d8a3ca None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:42.688534 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28a661-9c6b-40a3-afc3-6831d8f31186 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:42.702913 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 100/203] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:52:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:52:42.709525 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7cfcd-5c92-41f9-a521-ee69b6d8a3ca None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:42.728235 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fd910-6c8a-4995-9037-2392fd8949bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:42.728911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fd910-6c8a-4995-9037-2392fd8949bb None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:42.729185 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fd910-6c8a-4995-9037-2392fd8949bb None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:42.729457 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fd910-6c8a-4995-9037-2392fd8949bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:42.800703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fd910-6c8a-4995-9037-2392fd8949bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:42.802111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fd910-6c8a-4995-9037-2392fd8949bb None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:42.818908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7cfcd-5c92-41f9-a521-ee69b6d8a3ca None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:42.855767 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad3306-1df6-49ce-92bf-f48837b2086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:42.856624 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad3306-1df6-49ce-92bf-f48837b2086c None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:42.856906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad3306-1df6-49ce-92bf-f48837b2086c None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:42.857177 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad3306-1df6-49ce-92bf-f48837b2086c None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:42.858376 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad3306-1df6-49ce-92bf-f48837b2086c None admin] RBAC: Authorizing `identity:get_project(project_id=7de1a1d5d5f041ddbc5231b5975a3a68)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:42.859872 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad3306-1df6-49ce-92bf-f48837b2086c None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:42.862120 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 101/204] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:42 2022] GET /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:42.867609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad3306-1df6-49ce-92bf-f48837b2086c None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:42.905081 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 104/205] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:52:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:52:42.915737 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fd910-6c8a-4995-9037-2392fd8949bb None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:42.985459 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad3306-1df6-49ce-92bf-f48837b2086c None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:43.013677 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fd910-6c8a-4995-9037-2392fd8949bb None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:43.020853 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87894266-23d7-4ff4-af40-5325bd4e62fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:43.021563 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87894266-23d7-4ff4-af40-5325bd4e62fd None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:43.021843 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87894266-23d7-4ff4-af40-5325bd4e62fd None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:43.022127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87894266-23d7-4ff4-af40-5325bd4e62fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:43.023001 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87894266-23d7-4ff4-af40-5325bd4e62fd None admin] RBAC: Adding query filter params (role.id=f45adb34d54d49558694df72aec6b99d, scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68, user.id=da8e87c60a3b4d469944ab4c39032da7) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:43.023312 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87894266-23d7-4ff4-af40-5325bd4e62fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:43.024808 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87894266-23d7-4ff4-af40-5325bd4e62fd None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:43.030807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 102/206] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:52:42 2022] GET /identity/v3/role_assignments?user.id=da8e87c60a3b4d469944ab4c39032da7&scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68&role.id=f45adb34d54d49558694df72aec6b99d => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:43.059682 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8149a1-2e15-4b74-b3b4-cc5b1cc21f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:43.060480 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8149a1-2e15-4b74-b3b4-cc5b1cc21f7a None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:43.060759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8149a1-2e15-4b74-b3b4-cc5b1cc21f7a None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:43.061034 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8149a1-2e15-4b74-b3b4-cc5b1cc21f7a None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:43.062253 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8149a1-2e15-4b74-b3b4-cc5b1cc21f7a None admin] RBAC: Authorizing `identity:get_project(project_id=f86e7cbe28eb448b87b50a4d37dce199)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:43.064338 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8149a1-2e15-4b74-b3b4-cc5b1cc21f7a None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:43.066164 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 105/207] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:42 2022] GET /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:43.072214 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87894266-23d7-4ff4-af40-5325bd4e62fd None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:43.210475 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87894266-23d7-4ff4-af40-5325bd4e62fd None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:43.265970 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb6fa5-bba2-47b0-9b5d-541774a9df46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:43.267221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb6fa5-bba2-47b0-9b5d-541774a9df46 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:43.267504 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb6fa5-bba2-47b0-9b5d-541774a9df46 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:43.267810 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb6fa5-bba2-47b0-9b5d-541774a9df46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:43.268661 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb6fa5-bba2-47b0-9b5d-541774a9df46 None admin] RBAC: Adding query filter params (role.id=2088f05fbc394bb4a8b98c44c2af1309, scope.project.id=f86e7cbe28eb448b87b50a4d37dce199, user.id=5ac3b057b1004c9a8134a5691db06b9d) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:43.268972 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb6fa5-bba2-47b0-9b5d-541774a9df46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:43.270470 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb6fa5-bba2-47b0-9b5d-541774a9df46 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:43.280592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 103/208] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:52:43 2022] GET /identity/v3/role_assignments?user.id=5ac3b057b1004c9a8134a5691db06b9d&scope.project.id=f86e7cbe28eb448b87b50a4d37dce199&role.id=2088f05fbc394bb4a8b98c44c2af1309 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:45.051805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4266a4-10e7-42d2-ba2c-bf669f5dce9f None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.052829 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4266a4-10e7-42d2-ba2c-bf669f5dce9f None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.053332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4266a4-10e7-42d2-ba2c-bf669f5dce9f None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.054915 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 106/209] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:45.060559 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f32e8b-58e3-4eaa-bbd8-3c19ad19c69b None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.061373 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f32e8b-58e3-4eaa-bbd8-3c19ad19c69b None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.061954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f32e8b-58e3-4eaa-bbd8-3c19ad19c69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.080058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-b7f32e8b-58e3-4eaa-bbd8-3c19ad19c69b None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:45.081575 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-b7f32e8b-58e3-4eaa-bbd8-3c19ad19c69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:45.105095 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e4c8d-03df-46d3-b870-432c14d9a7c1 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.105705 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e4c8d-03df-46d3-b870-432c14d9a7c1 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.106209 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e4c8d-03df-46d3-b870-432c14d9a7c1 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.108095 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 107/210] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:45.114168 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b980a97-c3ed-4978-b066-5a852bd523b7 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.114703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b980a97-c3ed-4978-b066-5a852bd523b7 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.115191 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b980a97-c3ed-4978-b066-5a852bd523b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.132554 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-2b980a97-c3ed-4978-b066-5a852bd523b7 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:45.134067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-2b980a97-c3ed-4978-b066-5a852bd523b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:45.155800 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 104/211] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:45.175417 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f32e8b-58e3-4eaa-bbd8-3c19ad19c69b None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:45.203159 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 108/212] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:52:45.209146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e6559-9096-45ee-b0dd-846ea252aa1d None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.209434 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e6559-9096-45ee-b0dd-846ea252aa1d None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.209713 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e6559-9096-45ee-b0dd-846ea252aa1d None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.211369 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 109/213] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:45.216441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3276c5f-a24d-4ae2-85f1-8ab6b0587dbc None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.216961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3276c5f-a24d-4ae2-85f1-8ab6b0587dbc None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.217449 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3276c5f-a24d-4ae2-85f1-8ab6b0587dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.235851 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-c3276c5f-a24d-4ae2-85f1-8ab6b0587dbc None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:45.237247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-c3276c5f-a24d-4ae2-85f1-8ab6b0587dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:45.279687 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f32e8b-58e3-4eaa-bbd8-3c19ad19c69b None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:45.311785 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 110/214] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:52:45.312672 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3276c5f-a24d-4ae2-85f1-8ab6b0587dbc None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:45.315951 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb7555-33a8-43ee-9aa6-2305adb0ac33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:45.317706 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb7555-33a8-43ee-9aa6-2305adb0ac33 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.318186 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb7555-33a8-43ee-9aa6-2305adb0ac33 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.318634 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb7555-33a8-43ee-9aa6-2305adb0ac33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.330279 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb7555-33a8-43ee-9aa6-2305adb0ac33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:45.338113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-f9bb7555-33a8-43ee-9aa6-2305adb0ac33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:52:45.338113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:45.338113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:45.338113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:45.338113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:45.338113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:45.338113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:45.338113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:45.338113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:45.338113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:45.338113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:45.338113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:45.338113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:45.338113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:45.338113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:45.338113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:45.339167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:45.339167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:45.339167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:45.339167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:45.339167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:45.339167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:45.339167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:45.339167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:45.339167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:45.339167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:45.339167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:45.339167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:52:45.339167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:45.339167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:45.339167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:45.339167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:45.340161 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:45.340161 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:45.340161 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:45.340161 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:45.340161 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:45.340161 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:45.340161 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:45.340161 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:45.340161 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:45.340161 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:45.340161 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:52:45.340161 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:52:45.342433 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 105/215] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 12 16:52:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:52:45.349119 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb7555-33a8-43ee-9aa6-2305adb0ac33 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:45.415706 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3276c5f-a24d-4ae2-85f1-8ab6b0587dbc None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:45.449186 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb7555-33a8-43ee-9aa6-2305adb0ac33 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:45.449350 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63ea72-5e40-4beb-b6bf-2e81513873c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:45.449949 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63ea72-5e40-4beb-b6bf-2e81513873c1 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.450234 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63ea72-5e40-4beb-b6bf-2e81513873c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.450514 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63ea72-5e40-4beb-b6bf-2e81513873c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.460816 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63ea72-5e40-4beb-b6bf-2e81513873c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:45.468575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-3b63ea72-5e40-4beb-b6bf-2e81513873c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:45.468575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:45.468575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:45.468575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:45.468575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:45.468575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:45.468575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:45.468575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:45.468575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:45.468575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:45.468575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:45.468575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:45.468575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:45.468575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:45.468575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:45.468575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:45.469985 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:45.469985 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:45.469985 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:45.469985 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:45.469985 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:45.469985 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:45.469985 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:45.469985 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:45.469985 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:45.469985 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:45.469985 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:45.469985 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:52:45.469985 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:45.469985 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:45.469985 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:45.469985 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:45.470757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:45.470757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:45.470757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:45.470757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:45.470757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:45.470757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:45.470757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:45.470757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:45.470757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:45.470757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:45.470757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:45.470757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:52:45.470757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 111/216] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:45.471426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63ea72-5e40-4beb-b6bf-2e81513873c1 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:45.484554 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d37ff-e463-415e-885a-9960158e2e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:45.485900 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d37ff-e463-415e-885a-9960158e2e6d None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.486179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d37ff-e463-415e-885a-9960158e2e6d None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.486452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d37ff-e463-415e-885a-9960158e2e6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.487620 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d37ff-e463-415e-885a-9960158e2e6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:45.489112 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d37ff-e463-415e-885a-9960158e2e6d None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:45.495145 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 106/217] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:52:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:45.495145 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d37ff-e463-415e-885a-9960158e2e6d None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:45.580032 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63ea72-5e40-4beb-b6bf-2e81513873c1 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:45.593860 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d37ff-e463-415e-885a-9960158e2e6d None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:45.612449 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96196836-3c0e-455b-9e9c-84df0e062e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:45.613112 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96196836-3c0e-455b-9e9c-84df0e062e02 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.613404 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96196836-3c0e-455b-9e9c-84df0e062e02 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.613681 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96196836-3c0e-455b-9e9c-84df0e062e02 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.614423 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96196836-3c0e-455b-9e9c-84df0e062e02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:45.614733 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96196836-3c0e-455b-9e9c-84df0e062e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:45.616158 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96196836-3c0e-455b-9e9c-84df0e062e02 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:45.623859 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 112/218] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:45.624627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96196836-3c0e-455b-9e9c-84df0e062e02 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:45.629917 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1b048-2b27-4d59-8667-8c1e1761f8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:45.630583 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1b048-2b27-4d59-8667-8c1e1761f8fe None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.630864 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1b048-2b27-4d59-8667-8c1e1761f8fe None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.631139 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1b048-2b27-4d59-8667-8c1e1761f8fe None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.631914 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1b048-2b27-4d59-8667-8c1e1761f8fe None admin] RBAC: Adding query filter params (name=member) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:45.632223 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1b048-2b27-4d59-8667-8c1e1761f8fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:45.633609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1b048-2b27-4d59-8667-8c1e1761f8fe None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:45.642060 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 107/219] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:52:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:45.643323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ef290-6c54-42f0-a30c-a26af4e8208e None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.643614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ef290-6c54-42f0-a30c-a26af4e8208e None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.644191 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ef290-6c54-42f0-a30c-a26af4e8208e None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.646469 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 108/220] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:45.646655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ef290-6c54-42f0-a30c-a26af4e8208e None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:45.718377 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96196836-3c0e-455b-9e9c-84df0e062e02 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:45.742260 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ef290-6c54-42f0-a30c-a26af4e8208e None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:45.749785 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f49b3-8ee8-4e27-9725-2e440b79481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:45.751405 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f49b3-8ee8-4e27-9725-2e440b79481b None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.751405 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f49b3-8ee8-4e27-9725-2e440b79481b None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.751618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f49b3-8ee8-4e27-9725-2e440b79481b None admin] PATH_INFO: `/v3/users` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.752260 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f49b3-8ee8-4e27-9725-2e440b79481b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:45.753709 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392f49b3-8ee8-4e27-9725-2e440b79481b None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:45.772197 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 113/221] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 12 16:52:45 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:52:45.773144 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f49b3-8ee8-4e27-9725-2e440b79481b None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:45.775468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2601a-b38d-496f-9a4f-209b80152445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:45.776394 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2601a-b38d-496f-9a4f-209b80152445 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.776670 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2601a-b38d-496f-9a4f-209b80152445 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.776947 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2601a-b38d-496f-9a4f-209b80152445 None admin] PATH_INFO: `/v3/users/da8e87c60a3b4d469944ab4c39032da7` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.778227 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2601a-b38d-496f-9a4f-209b80152445 None admin] RBAC: Authorizing `identity:get_user(user_id=da8e87c60a3b4d469944ab4c39032da7)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:45.779770 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2601a-b38d-496f-9a4f-209b80152445 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:45.781508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 109/222] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:45 2022] GET /identity/v3/users/da8e87c60a3b4d469944ab4c39032da7 => generated 283 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:45.786295 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfb6af-563c-44f6-96de-cd5c4f02d281 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.786295 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfb6af-563c-44f6-96de-cd5c4f02d281 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.786295 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfb6af-563c-44f6-96de-cd5c4f02d281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.801879 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-eadfb6af-563c-44f6-96de-cd5c4f02d281 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:45.803671 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-eadfb6af-563c-44f6-96de-cd5c4f02d281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:45.872801 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 110/223] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:45.876320 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfb6af-563c-44f6-96de-cd5c4f02d281 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:45.892818 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f49b3-8ee8-4e27-9725-2e440b79481b None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:45.930179 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdc950-97a6-464a-8440-50a1a07a0d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:45.931058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdc950-97a6-464a-8440-50a1a07a0d2c None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:45.931339 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdc950-97a6-464a-8440-50a1a07a0d2c None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:45.931612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdc950-97a6-464a-8440-50a1a07a0d2c None admin] PATH_INFO: `/v3/users/7df7388cd1744cb89570ad265380f6c6` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:45.946521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdc950-97a6-464a-8440-50a1a07a0d2c None admin] RBAC: Authorizing `identity:get_user(user_id=7df7388cd1744cb89570ad265380f6c6)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:45.948067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdc950-97a6-464a-8440-50a1a07a0d2c None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:45.949816 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 114/224] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:45 2022] GET /identity/v3/users/7df7388cd1744cb89570ad265380f6c6 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:45.950595 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdc950-97a6-464a-8440-50a1a07a0d2c None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:45.994424 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfb6af-563c-44f6-96de-cd5c4f02d281 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:46.032850 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b9e89-eb3a-4ed8-9526-f4c4ef2455ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:46.033735 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b9e89-eb3a-4ed8-9526-f4c4ef2455ea None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:46.034021 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b9e89-eb3a-4ed8-9526-f4c4ef2455ea None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:46.034294 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b9e89-eb3a-4ed8-9526-f4c4ef2455ea None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:46.037156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b9e89-eb3a-4ed8-9526-f4c4ef2455ea None admin] RBAC: Authorizing `identity:get_project(project_id=7de1a1d5d5f041ddbc5231b5975a3a68)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:46.037787 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b9e89-eb3a-4ed8-9526-f4c4ef2455ea None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:46.039565 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 111/225] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:45 2022] GET /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:46.044853 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b9e89-eb3a-4ed8-9526-f4c4ef2455ea None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:46.064594 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdc950-97a6-464a-8440-50a1a07a0d2c None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:46.103179 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5176d4-7449-42fc-8955-68732f658526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:46.104049 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5176d4-7449-42fc-8955-68732f658526 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:46.104335 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5176d4-7449-42fc-8955-68732f658526 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:46.104607 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5176d4-7449-42fc-8955-68732f658526 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:46.115515 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5176d4-7449-42fc-8955-68732f658526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:46.123698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-5a5176d4-7449-42fc-8955-68732f658526 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:52:46.123698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:46.123698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:46.123698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:46.123698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:46.123698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:46.123698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:46.123698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:46.123698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:46.123698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:46.123698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:46.123698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:46.123698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:46.123698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:46.123698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:46.123698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:46.124866 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:46.124866 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:46.124866 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:46.124866 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:46.124866 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:46.124866 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:46.124866 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:46.124866 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:46.124866 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:46.124866 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:46.124866 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:46.124866 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:52:46.124866 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:46.124866 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:46.124866 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:46.124866 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:46.125843 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:46.125843 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:46.125843 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:46.125843 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:46.125843 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:46.125843 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:46.125843 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:46.125843 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:46.125843 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:46.125843 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:46.125843 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:52:46.125843 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:52:46.125843 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 115/226] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:52:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:46.126571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5176d4-7449-42fc-8955-68732f658526 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:46.157281 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b9e89-eb3a-4ed8-9526-f4c4ef2455ea None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:46.193874 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf678c-02b0-47fd-84fa-904044b3ed4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:46.194869 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf678c-02b0-47fd-84fa-904044b3ed4b None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:46.195487 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf678c-02b0-47fd-84fa-904044b3ed4b None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:46.196002 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf678c-02b0-47fd-84fa-904044b3ed4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:46.230373 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5176d4-7449-42fc-8955-68732f658526 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:46.266014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf678c-02b0-47fd-84fa-904044b3ed4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:46.267729 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4527926-173c-451f-b191-d993b2bdf365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:46.268718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4527926-173c-451f-b191-d993b2bdf365 None admin] REQUEST_METHOD: `PUT` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:46.268920 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf678c-02b0-47fd-84fa-904044b3ed4b None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:46.269200 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4527926-173c-451f-b191-d993b2bdf365 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:46.269657 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4527926-173c-451f-b191-d993b2bdf365 None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68/users/da8e87c60a3b4d469944ab4c39032da7/roles/fbd6364b42a641f695c0b265a789057a` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:46.273024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4527926-173c-451f-b191-d993b2bdf365 None admin] RBAC: Authorizing `identity:create_grant(project_id=7de1a1d5d5f041ddbc5231b5975a3a68, user_id=da8e87c60a3b4d469944ab4c39032da7, role_id=fbd6364b42a641f695c0b265a789057a)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:46.273933 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4527926-173c-451f-b191-d993b2bdf365 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:46.289853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 116/227] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 12 16:52:46 2022] PUT /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68/users/da8e87c60a3b4d469944ab4c39032da7/roles/fbd6364b42a641f695c0b265a789057a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:52:46.290476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4527926-173c-451f-b191-d993b2bdf365 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:46.379524 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 112/228] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:52:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:52:46.388723 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf678c-02b0-47fd-84fa-904044b3ed4b None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:46.413742 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4527926-173c-451f-b191-d993b2bdf365 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:46.484125 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d686d2-d03d-4de4-892d-40171e38ece3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:46.485343 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d686d2-d03d-4de4-892d-40171e38ece3 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:46.485626 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d686d2-d03d-4de4-892d-40171e38ece3 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:46.485901 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d686d2-d03d-4de4-892d-40171e38ece3 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:46.486666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d686d2-d03d-4de4-892d-40171e38ece3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:46.486975 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d686d2-d03d-4de4-892d-40171e38ece3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:46.488428 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d686d2-d03d-4de4-892d-40171e38ece3 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:46.504569 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 117/229] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:52:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:46.513096 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d686d2-d03d-4de4-892d-40171e38ece3 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:46.553582 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf678c-02b0-47fd-84fa-904044b3ed4b None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:46.604573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6a491-e346-499f-9a6f-cf02b8ca2a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:46.605847 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6a491-e346-499f-9a6f-cf02b8ca2a41 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:46.605847 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6a491-e346-499f-9a6f-cf02b8ca2a41 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:46.606123 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6a491-e346-499f-9a6f-cf02b8ca2a41 None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:46.608414 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6a491-e346-499f-9a6f-cf02b8ca2a41 None admin] RBAC: Authorizing `identity:get_project(project_id=7de1a1d5d5f041ddbc5231b5975a3a68)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:46.610392 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6a491-e346-499f-9a6f-cf02b8ca2a41 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:46.612661 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 113/230] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:46 2022] GET /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:46.619297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6a491-e346-499f-9a6f-cf02b8ca2a41 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:46.661308 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d686d2-d03d-4de4-892d-40171e38ece3 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:46.729084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf599ec-e0a0-4a5b-b12e-19ac666fa4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:46.730262 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf599ec-e0a0-4a5b-b12e-19ac666fa4f0 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:46.730687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf599ec-e0a0-4a5b-b12e-19ac666fa4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:46.731104 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf599ec-e0a0-4a5b-b12e-19ac666fa4f0 None admin] PATH_INFO: `/v3/users/da8e87c60a3b4d469944ab4c39032da7` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:46.734621 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6a491-e346-499f-9a6f-cf02b8ca2a41 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:46.735377 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf599ec-e0a0-4a5b-b12e-19ac666fa4f0 None admin] RBAC: Authorizing `identity:get_user(user_id=da8e87c60a3b4d469944ab4c39032da7)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:46.737069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf599ec-e0a0-4a5b-b12e-19ac666fa4f0 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:46.739174 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 118/231] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:46 2022] GET /identity/v3/users/da8e87c60a3b4d469944ab4c39032da7 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:46.748162 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf599ec-e0a0-4a5b-b12e-19ac666fa4f0 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:46.779518 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cf2a2-7fb5-4a68-b915-f24d53462a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:46.780201 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cf2a2-7fb5-4a68-b915-f24d53462a98 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:46.780481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cf2a2-7fb5-4a68-b915-f24d53462a98 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:46.780752 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cf2a2-7fb5-4a68-b915-f24d53462a98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:46.781571 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cf2a2-7fb5-4a68-b915-f24d53462a98 None admin] RBAC: Adding query filter params (role.id=0474b158b4bc4046ac169d53fff04721, scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68, user.id=7df7388cd1744cb89570ad265380f6c6) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:46.782399 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cf2a2-7fb5-4a68-b915-f24d53462a98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:46.783878 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cf2a2-7fb5-4a68-b915-f24d53462a98 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:46.801823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 114/232] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:52:46 2022] GET /identity/v3/role_assignments?user.id=7df7388cd1744cb89570ad265380f6c6&scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68&role.id=0474b158b4bc4046ac169d53fff04721 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:46.883972 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf599ec-e0a0-4a5b-b12e-19ac666fa4f0 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:46.927179 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f8d5e-b3a4-4708-a235-03388a0f297f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:46.928101 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f8d5e-b3a4-4708-a235-03388a0f297f None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:46.928382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f8d5e-b3a4-4708-a235-03388a0f297f None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:46.928655 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f8d5e-b3a4-4708-a235-03388a0f297f None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:46.932357 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f8d5e-b3a4-4708-a235-03388a0f297f None admin] RBAC: Authorizing `identity:get_project(project_id=7de1a1d5d5f041ddbc5231b5975a3a68)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:46.933850 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f8d5e-b3a4-4708-a235-03388a0f297f None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:46.936543 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 119/233] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:46 2022] GET /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:46.944801 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cf2a2-7fb5-4a68-b915-f24d53462a98 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:47.070237 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cf2a2-7fb5-4a68-b915-f24d53462a98 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:47.107382 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e031d-be4d-4e40-9263-f23cc9b709b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:47.108312 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e031d-be4d-4e40-9263-f23cc9b709b3 None admin] REQUEST_METHOD: `PUT` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:47.108592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e031d-be4d-4e40-9263-f23cc9b709b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:47.108860 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e031d-be4d-4e40-9263-f23cc9b709b3 None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68/users/da8e87c60a3b4d469944ab4c39032da7/roles/f45adb34d54d49558694df72aec6b99d` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:47.113087 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e031d-be4d-4e40-9263-f23cc9b709b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7de1a1d5d5f041ddbc5231b5975a3a68, user_id=da8e87c60a3b4d469944ab4c39032da7, role_id=f45adb34d54d49558694df72aec6b99d)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:47.114556 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e031d-be4d-4e40-9263-f23cc9b709b3 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:47.139743 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 115/234] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 12 16:52:46 2022] PUT /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68/users/da8e87c60a3b4d469944ab4c39032da7/roles/f45adb34d54d49558694df72aec6b99d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:52:48.527920 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0e066-6ed7-493b-8ded-74523f853478 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:48.528417 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0e066-6ed7-493b-8ded-74523f853478 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:48.528492 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0e066-6ed7-493b-8ded-74523f853478 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:48.530127 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 120/235] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:48.535594 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cae38-b578-4a24-a924-6876e3dfa775 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:48.536020 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cae38-b578-4a24-a924-6876e3dfa775 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:48.536203 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cae38-b578-4a24-a924-6876e3dfa775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:48.576786 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-077cae38-b578-4a24-a924-6876e3dfa775 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:48.577979 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-077cae38-b578-4a24-a924-6876e3dfa775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:48.662214 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 116/236] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:48.693525 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88b9e2-fa8e-4cd0-b378-252ff1bab7ec None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:48.693912 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88b9e2-fa8e-4cd0-b378-252ff1bab7ec None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:48.694326 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88b9e2-fa8e-4cd0-b378-252ff1bab7ec None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:48.696743 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 121/237] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:48.701901 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6fdb4-fe64-4363-b1de-94ba66579a12 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:48.702187 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6fdb4-fe64-4363-b1de-94ba66579a12 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:48.702458 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6fdb4-fe64-4363-b1de-94ba66579a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:48.706379 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88b9e2-fa8e-4cd0-b378-252ff1bab7ec None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:48.724641 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-6ca6fdb4-fe64-4363-b1de-94ba66579a12 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:48.725816 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-6ca6fdb4-fe64-4363-b1de-94ba66579a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:48.808430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88b9e2-fa8e-4cd0-b378-252ff1bab7ec None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:48.836390 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 117/238] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:48.859182 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb5d90-5859-4913-b562-dbf8c036a761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:48.860552 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb5d90-5859-4913-b562-dbf8c036a761 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:48.860834 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb5d90-5859-4913-b562-dbf8c036a761 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:48.861111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb5d90-5859-4913-b562-dbf8c036a761 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:48.880759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb5d90-5859-4913-b562-dbf8c036a761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:48.888417 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-52bb5d90-5859-4913-b562-dbf8c036a761 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:52:48.888417 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:48.888417 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:48.888417 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:48.888417 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:48.888417 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:48.888417 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:48.888417 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:48.888417 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:48.888417 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:48.888417 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:48.888417 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:48.888417 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:48.888417 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:48.888417 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:48.888417 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:48.890704 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:48.890704 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:48.890704 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:48.890704 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:48.890704 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:48.890704 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:48.890704 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:48.890704 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:48.890704 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:48.890704 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:48.890704 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:48.890704 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:52:48.890704 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:48.890704 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:48.890704 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:48.890704 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:48.892748 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:48.892748 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:48.892748 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:48.892748 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:48.892748 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:48.892748 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:48.892748 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:48.892748 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:48.892748 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:48.892748 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:48.892748 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:52:48.892748 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:52:48.896359 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6fdb4-fe64-4363-b1de-94ba66579a12 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:48.896524 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 122/239] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:52:48.904136 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb5d90-5859-4913-b562-dbf8c036a761 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:49.008310 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb5d90-5859-4913-b562-dbf8c036a761 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:49.043349 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4226316-f6c7-4a59-955e-e83b68867e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:49.044182 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4226316-f6c7-4a59-955e-e83b68867e6d None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:49.044465 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4226316-f6c7-4a59-955e-e83b68867e6d None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:49.044743 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4226316-f6c7-4a59-955e-e83b68867e6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:49.045928 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4226316-f6c7-4a59-955e-e83b68867e6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:49.047991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4226316-f6c7-4a59-955e-e83b68867e6d None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:49.049910 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 123/240] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:52:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:49.055176 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4226316-f6c7-4a59-955e-e83b68867e6d None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:49.154400 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4226316-f6c7-4a59-955e-e83b68867e6d None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:49.158309 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6fdb4-fe64-4363-b1de-94ba66579a12 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:49.188443 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20689612-bf30-4a8e-8720-9452c75c8d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:49.189115 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20689612-bf30-4a8e-8720-9452c75c8d00 None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:49.189398 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20689612-bf30-4a8e-8720-9452c75c8d00 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:49.189673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20689612-bf30-4a8e-8720-9452c75c8d00 None admin] PATH_INFO: `/v3/users` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:49.190383 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20689612-bf30-4a8e-8720-9452c75c8d00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:49.191877 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20689612-bf30-4a8e-8720-9452c75c8d00 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:49.215249 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 124/241] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 12 16:52:49 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 16:52:49.215741 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059f903-f3e1-489d-8f63-8c09012d2922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:49.216416 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059f903-f3e1-489d-8f63-8c09012d2922 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:49.216628 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc5274-ca8e-447a-8b7a-9cac8bab7c1a None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:49.216725 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059f903-f3e1-489d-8f63-8c09012d2922 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:49.216871 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc5274-ca8e-447a-8b7a-9cac8bab7c1a None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:49.216960 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059f903-f3e1-489d-8f63-8c09012d2922 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:49.217796 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059f903-f3e1-489d-8f63-8c09012d2922 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:49.218106 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059f903-f3e1-489d-8f63-8c09012d2922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:49.220175 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059f903-f3e1-489d-8f63-8c09012d2922 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:49.224196 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc5274-ca8e-447a-8b7a-9cac8bab7c1a None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:49.226727 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 125/242] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:49 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:49.232506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 118/243] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:52:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:49.232677 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1041ae-7e18-459b-aa93-e0fafd36e115 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:49.232910 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1041ae-7e18-459b-aa93-e0fafd36e115 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:49.233154 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1041ae-7e18-459b-aa93-e0fafd36e115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:49.238505 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059f903-f3e1-489d-8f63-8c09012d2922 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:49.265286 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-4a1041ae-7e18-459b-aa93-e0fafd36e115 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:49.267511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-4a1041ae-7e18-459b-aa93-e0fafd36e115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:49.426760 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 126/244] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:52:49.435855 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059f903-f3e1-489d-8f63-8c09012d2922 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:49.452853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1041ae-7e18-459b-aa93-e0fafd36e115 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:49.481646 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636b598-7483-4902-8691-0dd02a7ca1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:49.483673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636b598-7483-4902-8691-0dd02a7ca1a3 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:49.484134 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636b598-7483-4902-8691-0dd02a7ca1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:49.484756 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636b598-7483-4902-8691-0dd02a7ca1a3 None admin] PATH_INFO: `/v3/users/314b5a80eec4498c85ec5c484724af11` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:49.504354 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636b598-7483-4902-8691-0dd02a7ca1a3 None admin] RBAC: Authorizing `identity:get_user(user_id=314b5a80eec4498c85ec5c484724af11)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:49.506825 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636b598-7483-4902-8691-0dd02a7ca1a3 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:49.509601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 119/245] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:49 2022] GET /identity/v3/users/314b5a80eec4498c85ec5c484724af11 => generated 297 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:52:49.514620 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636b598-7483-4902-8691-0dd02a7ca1a3 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:49.566915 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1041ae-7e18-459b-aa93-e0fafd36e115 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:49.604352 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ba309-0a60-4e1f-b017-a21b7fae0179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:49.605340 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ba309-0a60-4e1f-b017-a21b7fae0179 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:49.605557 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ba309-0a60-4e1f-b017-a21b7fae0179 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:49.605845 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ba309-0a60-4e1f-b017-a21b7fae0179 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:49.619106 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ba309-0a60-4e1f-b017-a21b7fae0179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:49.628690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-af3ba309-0a60-4e1f-b017-a21b7fae0179 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:52:49.628690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:49.628690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:49.628690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:49.628690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:49.628690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:49.628690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:49.628690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:49.628690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:49.628690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:49.628690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:49.628690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:49.628690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:49.628690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:49.628690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:49.628690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:49.630247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:49.630247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:49.630247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:49.630247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:49.630247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:49.630247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:49.630247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:49.630247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:49.630247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:49.630247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:49.630247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:49.630247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:52:49.630247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:49.630247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:49.630247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:49.630247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:49.631343 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:49.631343 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:49.631343 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:49.631343 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:49.631343 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:49.631343 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:49.631343 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:49.631343 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:49.631343 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:49.631343 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:49.631343 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:52:49.631343 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:52:49.631343 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 127/246] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 12 16:52:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:52:49.637787 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636b598-7483-4902-8691-0dd02a7ca1a3 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:49.638787 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ba309-0a60-4e1f-b017-a21b7fae0179 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:49.680094 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefb254-6bdf-42c1-8fda-af04b1393d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:49.681113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefb254-6bdf-42c1-8fda-af04b1393d30 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:49.681674 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefb254-6bdf-42c1-8fda-af04b1393d30 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:49.682161 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefb254-6bdf-42c1-8fda-af04b1393d30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:49.751499 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ba309-0a60-4e1f-b017-a21b7fae0179 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:49.753837 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefb254-6bdf-42c1-8fda-af04b1393d30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:49.755694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefb254-6bdf-42c1-8fda-af04b1393d30 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:49.786599 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950c0c4-9206-4b55-8715-ad0bca29f23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:49.787277 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950c0c4-9206-4b55-8715-ad0bca29f23c None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:49.787563 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950c0c4-9206-4b55-8715-ad0bca29f23c None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:49.788045 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950c0c4-9206-4b55-8715-ad0bca29f23c None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:49.788876 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950c0c4-9206-4b55-8715-ad0bca29f23c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:49.789192 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950c0c4-9206-4b55-8715-ad0bca29f23c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:49.790606 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950c0c4-9206-4b55-8715-ad0bca29f23c None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:49.799834 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 128/247] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:49.805381 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950c0c4-9206-4b55-8715-ad0bca29f23c None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:49.862148 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 120/248] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:52:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:52:49.869879 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefb254-6bdf-42c1-8fda-af04b1393d30 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:49.922518 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950c0c4-9206-4b55-8715-ad0bca29f23c None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:49.973850 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e70f9-0b05-4ba8-8f44-727c15e4712f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:49.974657 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e70f9-0b05-4ba8-8f44-727c15e4712f None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:49.974940 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e70f9-0b05-4ba8-8f44-727c15e4712f None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:49.975219 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e70f9-0b05-4ba8-8f44-727c15e4712f None admin] PATH_INFO: `/v3/users/da8e87c60a3b4d469944ab4c39032da7` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:49.976724 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e70f9-0b05-4ba8-8f44-727c15e4712f None admin] RBAC: Authorizing `identity:get_user(user_id=da8e87c60a3b4d469944ab4c39032da7)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:49.978207 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e70f9-0b05-4ba8-8f44-727c15e4712f None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:49.980198 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 129/249] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:49 2022] GET /identity/v3/users/da8e87c60a3b4d469944ab4c39032da7 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:49.987424 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961523e-2ca3-4e3b-b077-b5fd24666134 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:49.987424 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961523e-2ca3-4e3b-b077-b5fd24666134 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:49.987424 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961523e-2ca3-4e3b-b077-b5fd24666134 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:49.989043 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 130/250] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:49.989825 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961523e-2ca3-4e3b-b077-b5fd24666134 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:49.991513 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefb254-6bdf-42c1-8fda-af04b1393d30 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:50.032321 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c241d-c9e6-456d-a20e-87cb4e3d926f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:50.033594 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c241d-c9e6-456d-a20e-87cb4e3d926f None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:50.034083 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c241d-c9e6-456d-a20e-87cb4e3d926f None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:50.034551 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c241d-c9e6-456d-a20e-87cb4e3d926f None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:50.036071 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c241d-c9e6-456d-a20e-87cb4e3d926f None admin] RBAC: Authorizing `identity:get_project(project_id=7de1a1d5d5f041ddbc5231b5975a3a68)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:50.037804 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c241d-c9e6-456d-a20e-87cb4e3d926f None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:50.039839 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 121/251] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:49 2022] GET /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:50.041276 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded3afa-8116-473e-815b-005390e3f892 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:50.041757 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded3afa-8116-473e-815b-005390e3f892 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:50.042334 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded3afa-8116-473e-815b-005390e3f892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:50.061473 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-eded3afa-8116-473e-815b-005390e3f892 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:50.063493 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-eded3afa-8116-473e-815b-005390e3f892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:50.135341 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961523e-2ca3-4e3b-b077-b5fd24666134 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:50.149313 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 122/252] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:50.150864 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded3afa-8116-473e-815b-005390e3f892 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:50.169132 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ae5ed-ba36-4e02-ab32-2a32cfd4949b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:50.169782 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ae5ed-ba36-4e02-ab32-2a32cfd4949b None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:50.170060 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ae5ed-ba36-4e02-ab32-2a32cfd4949b None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:50.170332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ae5ed-ba36-4e02-ab32-2a32cfd4949b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:50.240228 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ae5ed-ba36-4e02-ab32-2a32cfd4949b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:50.241657 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ae5ed-ba36-4e02-ab32-2a32cfd4949b None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:50.282755 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded3afa-8116-473e-815b-005390e3f892 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:50.327284 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4d62a-1f4a-4d13-8c81-f8f7a3882e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:50.327562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4d62a-1f4a-4d13-8c81-f8f7a3882e0e None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:50.327854 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4d62a-1f4a-4d13-8c81-f8f7a3882e0e None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:50.328125 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4d62a-1f4a-4d13-8c81-f8f7a3882e0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:50.328988 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4d62a-1f4a-4d13-8c81-f8f7a3882e0e None admin] RBAC: Adding query filter params (role.id=2088f05fbc394bb4a8b98c44c2af1309, scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68, user.id=314b5a80eec4498c85ec5c484724af11) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:50.329294 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4d62a-1f4a-4d13-8c81-f8f7a3882e0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:50.330756 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a4d62a-1f4a-4d13-8c81-f8f7a3882e0e None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:50.336565 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 123/253] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:52:50 2022] GET /identity/v3/role_assignments?user.id=314b5a80eec4498c85ec5c484724af11&scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68&role.id=2088f05fbc394bb4a8b98c44c2af1309 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:50.337830 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac332f01-f0f2-4d26-9a4c-c3d54d0f1eee None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:50.338117 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac332f01-f0f2-4d26-9a4c-c3d54d0f1eee None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:50.338493 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac332f01-f0f2-4d26-9a4c-c3d54d0f1eee None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:50.339776 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 124/254] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:50.344791 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac332f01-f0f2-4d26-9a4c-c3d54d0f1eee None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:50.369780 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 131/255] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:52:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:52:50.371414 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5738bc5-f12a-4f71-bd55-7b5f46d0a640 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:50.373718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5738bc5-f12a-4f71-bd55-7b5f46d0a640 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:50.374188 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5738bc5-f12a-4f71-bd55-7b5f46d0a640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:50.411664 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-d5738bc5-f12a-4f71-bd55-7b5f46d0a640 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:50.415712 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-d5738bc5-f12a-4f71-bd55-7b5f46d0a640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:50.547878 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac332f01-f0f2-4d26-9a4c-c3d54d0f1eee None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:50.550852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 132/256] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:50.551889 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5738bc5-f12a-4f71-bd55-7b5f46d0a640 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:50.592289 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdaadd1-b902-4c0b-9b2d-e25c91bd39d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:50.593093 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaadd1-b902-4c0b-9b2d-e25c91bd39d5 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:50.593375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaadd1-b902-4c0b-9b2d-e25c91bd39d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:50.593647 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdaadd1-b902-4c0b-9b2d-e25c91bd39d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:50.612181 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdaadd1-b902-4c0b-9b2d-e25c91bd39d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:50.620803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-afdaadd1-b902-4c0b-9b2d-e25c91bd39d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:50.620803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:50.620803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:50.620803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:50.620803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:50.620803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:50.620803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:50.620803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:50.620803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:50.620803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:50.620803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:50.620803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:50.620803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:50.620803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:50.620803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:50.620803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:50.621639 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:50.621639 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:50.621639 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:50.621639 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:50.621639 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:50.621639 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:50.621639 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:50.621639 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:50.621639 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:50.621639 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:50.621639 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:50.621639 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:52:50.621639 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:50.621639 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:50.621639 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:50.621639 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:50.622424 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:50.622424 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:50.622424 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:50.622424 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:50.622424 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:50.622424 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:50.622424 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:50.622424 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:50.622424 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:50.622424 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:50.622424 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:50.622424 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:52:50.625006 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 125/257] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:50.625983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdaadd1-b902-4c0b-9b2d-e25c91bd39d5 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:50.726840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5738bc5-f12a-4f71-bd55-7b5f46d0a640 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:50.785238 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db4bac-8b50-43c9-bd42-53e248cfcf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:50.786113 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db4bac-8b50-43c9-bd42-53e248cfcf2f None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:50.786388 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db4bac-8b50-43c9-bd42-53e248cfcf2f None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:50.786657 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db4bac-8b50-43c9-bd42-53e248cfcf2f None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:50.788475 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db4bac-8b50-43c9-bd42-53e248cfcf2f None admin] RBAC: Authorizing `identity:get_project(project_id=7de1a1d5d5f041ddbc5231b5975a3a68)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:50.789932 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db4bac-8b50-43c9-bd42-53e248cfcf2f None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:50.792105 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 133/258] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:50 2022] GET /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:50.792881 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db4bac-8b50-43c9-bd42-53e248cfcf2f None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:50.811795 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdaadd1-b902-4c0b-9b2d-e25c91bd39d5 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:50.868419 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdf743-8737-40b2-a626-6669dd0e44a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:50.869228 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdf743-8737-40b2-a626-6669dd0e44a1 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:50.869506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdf743-8737-40b2-a626-6669dd0e44a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:50.869777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdf743-8737-40b2-a626-6669dd0e44a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:50.889375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdf743-8737-40b2-a626-6669dd0e44a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:50.898936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-edcdf743-8737-40b2-a626-6669dd0e44a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:52:50.898936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:50.898936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:50.898936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:50.898936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:50.898936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:50.898936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:50.898936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:50.898936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:50.898936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:50.898936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:50.898936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:50.898936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:50.898936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:50.898936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:50.898936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:50.899840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:50.899840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:50.899840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:50.899840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:50.899840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:50.899840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:50.899840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:50.899840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:50.899840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:50.899840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:50.899840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:50.899840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:52:50.899840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:50.899840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:50.899840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:50.899840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:50.901083 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:50.901083 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:50.901083 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:50.901083 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:50.901083 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:50.901083 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:50.901083 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:50.901083 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:50.901083 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:50.901083 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:50.901083 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:52:50.901083 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:52:50.901083 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 126/259] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:52:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:50.901711 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdf743-8737-40b2-a626-6669dd0e44a1 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:50.966565 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db4bac-8b50-43c9-bd42-53e248cfcf2f None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:51.015491 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdf743-8737-40b2-a626-6669dd0e44a1 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:51.020840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adefcd-9a12-4a15-be51-886ca4b289f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:51.021786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adefcd-9a12-4a15-be51-886ca4b289f2 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:51.022211 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adefcd-9a12-4a15-be51-886ca4b289f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:51.022625 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adefcd-9a12-4a15-be51-886ca4b289f2 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:51.023580 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adefcd-9a12-4a15-be51-886ca4b289f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:51.024145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adefcd-9a12-4a15-be51-886ca4b289f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:51.026070 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adefcd-9a12-4a15-be51-886ca4b289f2 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:51.036139 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 134/260] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:52:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:51.037270 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adefcd-9a12-4a15-be51-886ca4b289f2 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:51.059546 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938920b-c050-43bd-864d-ddc0ed590919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:51.060236 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938920b-c050-43bd-864d-ddc0ed590919 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:51.060516 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938920b-c050-43bd-864d-ddc0ed590919 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:51.060794 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938920b-c050-43bd-864d-ddc0ed590919 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:51.061671 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938920b-c050-43bd-864d-ddc0ed590919 None admin] RBAC: Adding query filter params (role.id=fbd6364b42a641f695c0b265a789057a, scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68, user.id=da8e87c60a3b4d469944ab4c39032da7) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:51.062033 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938920b-c050-43bd-864d-ddc0ed590919 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:51.063509 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938920b-c050-43bd-864d-ddc0ed590919 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:51.075664 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 127/261] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:52:50 2022] GET /identity/v3/role_assignments?user.id=da8e87c60a3b4d469944ab4c39032da7&scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68&role.id=fbd6364b42a641f695c0b265a789057a => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:51.075664 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938920b-c050-43bd-864d-ddc0ed590919 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:51.245914 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adefcd-9a12-4a15-be51-886ca4b289f2 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:51.311593 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938920b-c050-43bd-864d-ddc0ed590919 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:51.337196 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce3e75-4729-41c9-8f2b-7daee0e23cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:51.337963 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce3e75-4729-41c9-8f2b-7daee0e23cea None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:51.338351 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce3e75-4729-41c9-8f2b-7daee0e23cea None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:51.338748 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce3e75-4729-41c9-8f2b-7daee0e23cea None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:51.339612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce3e75-4729-41c9-8f2b-7daee0e23cea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:51.340045 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce3e75-4729-41c9-8f2b-7daee0e23cea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:51.341616 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce3e75-4729-41c9-8f2b-7daee0e23cea None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:51.362678 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 135/262] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:52:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:51.367871 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674186f-bfbe-4f5b-a6d8-2d6598f5f207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:51.369193 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce3e75-4729-41c9-8f2b-7daee0e23cea None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:51.370184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674186f-bfbe-4f5b-a6d8-2d6598f5f207 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:51.370603 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674186f-bfbe-4f5b-a6d8-2d6598f5f207 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:51.371013 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674186f-bfbe-4f5b-a6d8-2d6598f5f207 None admin] PATH_INFO: `/v3/users/7df7388cd1744cb89570ad265380f6c6` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:51.373817 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674186f-bfbe-4f5b-a6d8-2d6598f5f207 None admin] RBAC: Authorizing `identity:get_user(user_id=7df7388cd1744cb89570ad265380f6c6)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:51.376242 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674186f-bfbe-4f5b-a6d8-2d6598f5f207 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:51.382255 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 128/263] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:51 2022] GET /identity/v3/users/7df7388cd1744cb89570ad265380f6c6 => generated 297 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:51.421864 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674186f-bfbe-4f5b-a6d8-2d6598f5f207 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:51.526409 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674186f-bfbe-4f5b-a6d8-2d6598f5f207 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:51.526632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce3e75-4729-41c9-8f2b-7daee0e23cea None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:51.564284 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01f331-377d-4564-8a6e-a3886ec0aa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:51.565702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01f331-377d-4564-8a6e-a3886ec0aa4d None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:51.566950 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51eb88-3b6d-4aa6-976c-435811c949e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:51.567384 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01f331-377d-4564-8a6e-a3886ec0aa4d None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:51.568431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51eb88-3b6d-4aa6-976c-435811c949e6 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:51.568843 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01f331-377d-4564-8a6e-a3886ec0aa4d None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:51.569789 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51eb88-3b6d-4aa6-976c-435811c949e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:51.570556 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01f331-377d-4564-8a6e-a3886ec0aa4d None admin] RBAC: Authorizing `identity:get_project(project_id=7de1a1d5d5f041ddbc5231b5975a3a68)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:51.570968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51eb88-3b6d-4aa6-976c-435811c949e6 None admin] PATH_INFO: `/v3/users/da8e87c60a3b4d469944ab4c39032da7` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:51.573150 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01f331-377d-4564-8a6e-a3886ec0aa4d None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:51.575021 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 129/264] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:51 2022] GET /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:52:51.575522 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51eb88-3b6d-4aa6-976c-435811c949e6 None admin] RBAC: Authorizing `identity:get_user(user_id=da8e87c60a3b4d469944ab4c39032da7)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:51.577084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51eb88-3b6d-4aa6-976c-435811c949e6 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:51.578997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 136/265] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:51 2022] GET /identity/v3/users/da8e87c60a3b4d469944ab4c39032da7 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:51.584763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01f331-377d-4564-8a6e-a3886ec0aa4d None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:51.585029 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51eb88-3b6d-4aa6-976c-435811c949e6 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:51.687871 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51eb88-3b6d-4aa6-976c-435811c949e6 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:51.718813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01f331-377d-4564-8a6e-a3886ec0aa4d None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:51.724064 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b3d8f-1d34-4171-8e75-d01e2c7654ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:51.724996 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b3d8f-1d34-4171-8e75-d01e2c7654ac None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:51.725474 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b3d8f-1d34-4171-8e75-d01e2c7654ac None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:51.725912 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b3d8f-1d34-4171-8e75-d01e2c7654ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:51.764353 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b3ab0-6dd7-4536-8000-5c2745597afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:51.765283 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b3ab0-6dd7-4536-8000-5c2745597afb None admin] REQUEST_METHOD: `PUT` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:51.765570 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b3ab0-6dd7-4536-8000-5c2745597afb None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:51.766374 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b3ab0-6dd7-4536-8000-5c2745597afb None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68/users/7df7388cd1744cb89570ad265380f6c6/roles/0474b158b4bc4046ac169d53fff04721` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:51.768514 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b3ab0-6dd7-4536-8000-5c2745597afb None admin] RBAC: Authorizing `identity:create_grant(project_id=7de1a1d5d5f041ddbc5231b5975a3a68, user_id=7df7388cd1744cb89570ad265380f6c6, role_id=0474b158b4bc4046ac169d53fff04721)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:51.769981 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b3ab0-6dd7-4536-8000-5c2745597afb None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:51.798151 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b3d8f-1d34-4171-8e75-d01e2c7654ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:51.800263 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b3d8f-1d34-4171-8e75-d01e2c7654ac None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:51.800980 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 130/266] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 12 16:52:51 2022] PUT /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68/users/7df7388cd1744cb89570ad265380f6c6/roles/0474b158b4bc4046ac169d53fff04721 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 16:52:51.922460 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 137/267] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:52:51.928177 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b3ab0-6dd7-4536-8000-5c2745597afb None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:52.055138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b3ab0-6dd7-4536-8000-5c2745597afb None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:52.092422 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79684ad9-906f-4334-b7fe-286665562d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:52.093667 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79684ad9-906f-4334-b7fe-286665562d69 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:52.094190 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79684ad9-906f-4334-b7fe-286665562d69 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:52.094682 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79684ad9-906f-4334-b7fe-286665562d69 None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:52.096104 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79684ad9-906f-4334-b7fe-286665562d69 None admin] RBAC: Authorizing `identity:get_project(project_id=7de1a1d5d5f041ddbc5231b5975a3a68)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:52.097750 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79684ad9-906f-4334-b7fe-286665562d69 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:52.099962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 131/268] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:51 2022] GET /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:52.108708 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b3d8f-1d34-4171-8e75-d01e2c7654ac None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:52.254798 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b3d8f-1d34-4171-8e75-d01e2c7654ac None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:52.302825 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33797fe-f3e2-4155-8610-954496e997d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:52.303505 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33797fe-f3e2-4155-8610-954496e997d0 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:52.303817 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33797fe-f3e2-4155-8610-954496e997d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:52.304096 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33797fe-f3e2-4155-8610-954496e997d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:52.304943 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33797fe-f3e2-4155-8610-954496e997d0 None admin] RBAC: Adding query filter params (role.id=f45adb34d54d49558694df72aec6b99d, scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68, user.id=da8e87c60a3b4d469944ab4c39032da7) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:52.305307 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33797fe-f3e2-4155-8610-954496e997d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:52.306730 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33797fe-f3e2-4155-8610-954496e997d0 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:52.319991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 138/269] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:52:52 2022] GET /identity/v3/role_assignments?user.id=da8e87c60a3b4d469944ab4c39032da7&scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68&role.id=f45adb34d54d49558694df72aec6b99d => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:52:52.650854 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d878d0-e32e-466f-831f-53b15c692358 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:52.650854 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d878d0-e32e-466f-831f-53b15c692358 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:52.650854 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d878d0-e32e-466f-831f-53b15c692358 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:52.651730 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 132/270] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:52.656445 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640038-0ab3-4931-8e2e-c93a2edec2bb None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:52.656742 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640038-0ab3-4931-8e2e-c93a2edec2bb None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:52.657022 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640038-0ab3-4931-8e2e-c93a2edec2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:52.680507 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-3e640038-0ab3-4931-8e2e-c93a2edec2bb None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:52.681708 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-3e640038-0ab3-4931-8e2e-c93a2edec2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:52.771327 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 139/271] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:52.798154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d878d0-e32e-466f-831f-53b15c692358 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:52.916887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d878d0-e32e-466f-831f-53b15c692358 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:52.927997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98fa60-c422-4690-be25-5b1940495792 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:52.928454 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98fa60-c422-4690-be25-5b1940495792 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:52.928645 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98fa60-c422-4690-be25-5b1940495792 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:52.930217 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 140/272] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:52.937167 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de694a4f-b280-4e7c-b9eb-31f442434d57 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:52.937452 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de694a4f-b280-4e7c-b9eb-31f442434d57 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:52.937771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de694a4f-b280-4e7c-b9eb-31f442434d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:52.956259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22596f17-3496-4233-9bc1-41284e9de27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:52.957193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22596f17-3496-4233-9bc1-41284e9de27a None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:52.957366 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22596f17-3496-4233-9bc1-41284e9de27a None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:52.960475 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22596f17-3496-4233-9bc1-41284e9de27a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:52.966086 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-de694a4f-b280-4e7c-b9eb-31f442434d57 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:52.967468 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-de694a4f-b280-4e7c-b9eb-31f442434d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:52.973832 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22596f17-3496-4233-9bc1-41284e9de27a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:52.982267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-22596f17-3496-4233-9bc1-41284e9de27a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:52.982267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:52.982267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:52.982267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:52.982267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:52.982267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:52.982267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:52.982267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:52.982267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:52.982267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:52.982267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:52.982267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:52.982267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:52.982267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:52.982267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:52.982267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:52.983157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:52.983157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:52.983157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:52.983157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:52.983157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:52.983157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:52.983157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:52.983157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:52.983157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:52.983157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:52.983157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:52.983157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:52:52.983157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:52.983157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:52.983157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:52.983157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:52.983976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:52.983976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:52.983976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:52.983976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:52.983976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:52.983976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:52.983976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:52.983976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:52.983976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:52.983976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:52.983976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:52.983976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:52:52.983976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 133/273] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:52.991610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22596f17-3496-4233-9bc1-41284e9de27a None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:53.039477 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 141/274] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:53.066311 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de694a4f-b280-4e7c-b9eb-31f442434d57 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:53.100701 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22596f17-3496-4233-9bc1-41284e9de27a None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:53.138685 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c07845-2317-428b-a2ea-e1fba16a411e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:53.139943 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c07845-2317-428b-a2ea-e1fba16a411e None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:53.139943 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c07845-2317-428b-a2ea-e1fba16a411e None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:53.140227 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c07845-2317-428b-a2ea-e1fba16a411e None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:53.141514 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c07845-2317-428b-a2ea-e1fba16a411e None admin] RBAC: Adding query filter params (name=member) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:53.141821 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c07845-2317-428b-a2ea-e1fba16a411e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:53.143231 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c07845-2317-428b-a2ea-e1fba16a411e None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:53.158577 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 134/275] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:52:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:53.159841 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c07845-2317-428b-a2ea-e1fba16a411e None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:53.190553 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de694a4f-b280-4e7c-b9eb-31f442434d57 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:53.229044 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7af6f6-8fde-449e-9957-c97deba98495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:53.229807 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7af6f6-8fde-449e-9957-c97deba98495 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:53.230139 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7af6f6-8fde-449e-9957-c97deba98495 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:53.230421 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7af6f6-8fde-449e-9957-c97deba98495 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:53.231581 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7af6f6-8fde-449e-9957-c97deba98495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:53.233086 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7af6f6-8fde-449e-9957-c97deba98495 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:53.235682 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 142/276] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:52:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:52:53.240417 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7af6f6-8fde-449e-9957-c97deba98495 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:53.286426 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c07845-2317-428b-a2ea-e1fba16a411e None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:53.319803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5975cc-a740-4737-837d-e83542a909f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:53.320753 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5975cc-a740-4737-837d-e83542a909f2 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:53.320953 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5975cc-a740-4737-837d-e83542a909f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:53.321226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5975cc-a740-4737-837d-e83542a909f2 None admin] PATH_INFO: `/v3/users/9844c451143647c992be7c4ac7699570` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:53.334661 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5975cc-a740-4737-837d-e83542a909f2 None admin] RBAC: Authorizing `identity:get_user(user_id=9844c451143647c992be7c4ac7699570)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:53.336178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5975cc-a740-4737-837d-e83542a909f2 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:53.342731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 135/277] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:53 2022] GET /identity/v3/users/9844c451143647c992be7c4ac7699570 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:53.342731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22697bf5-8d8e-4dce-934f-0d0b924b5168 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:53.342731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22697bf5-8d8e-4dce-934f-0d0b924b5168 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:53.343077 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7af6f6-8fde-449e-9957-c97deba98495 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:53.343165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22697bf5-8d8e-4dce-934f-0d0b924b5168 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:53.343165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 136/278] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:53.345596 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22697bf5-8d8e-4dce-934f-0d0b924b5168 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:53.380577 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f0b9c-0d51-4bbe-a3fe-372d61e558b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:53.381251 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f0b9c-0d51-4bbe-a3fe-372d61e558b2 None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:53.381532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f0b9c-0d51-4bbe-a3fe-372d61e558b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:53.381807 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f0b9c-0d51-4bbe-a3fe-372d61e558b2 None admin] PATH_INFO: `/v3/users` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:53.382511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f0b9c-0d51-4bbe-a3fe-372d61e558b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:53.383990 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f0b9c-0d51-4bbe-a3fe-372d61e558b2 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:53.406183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 143/279] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 12 16:52:53 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:52:53.408110 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946d543-d547-4cda-9f2f-d9700b7688d6 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:53.408384 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946d543-d547-4cda-9f2f-d9700b7688d6 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:53.408661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946d543-d547-4cda-9f2f-d9700b7688d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:53.430024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-3946d543-d547-4cda-9f2f-d9700b7688d6 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:53.431348 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-3946d543-d547-4cda-9f2f-d9700b7688d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:53.471618 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22697bf5-8d8e-4dce-934f-0d0b924b5168 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:53.508390 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 144/280] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:53.512396 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f146b-efa5-466e-ac0a-afcdfe3b0642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:53.513113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f146b-efa5-466e-ac0a-afcdfe3b0642 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:53.513391 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f146b-efa5-466e-ac0a-afcdfe3b0642 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:53.513659 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f146b-efa5-466e-ac0a-afcdfe3b0642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:53.514531 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f146b-efa5-466e-ac0a-afcdfe3b0642 None admin] RBAC: Adding query filter params (role.id=0474b158b4bc4046ac169d53fff04721, user.id=9844c451143647c992be7c4ac7699570, scope.system=all) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:53.514847 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f146b-efa5-466e-ac0a-afcdfe3b0642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:53.516898 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f146b-efa5-466e-ac0a-afcdfe3b0642 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:53.522332 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 137/281] 10.222.0.64 () {56 vars in 1308 bytes} [Thu May 12 16:52:53 2022] GET /identity/v3/role_assignments?user.id=9844c451143647c992be7c4ac7699570&scope.system=all&role.id=0474b158b4bc4046ac169d53fff04721 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:53.534470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946d543-d547-4cda-9f2f-d9700b7688d6 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:53.657539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946d543-d547-4cda-9f2f-d9700b7688d6 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:53.694484 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd1813-a172-431c-a938-52a0c4297544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:53.695303 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd1813-a172-431c-a938-52a0c4297544 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:53.695580 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd1813-a172-431c-a938-52a0c4297544 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:53.695894 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd1813-a172-431c-a938-52a0c4297544 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:53.708391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd1813-a172-431c-a938-52a0c4297544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:53.716476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-66bd1813-a172-431c-a938-52a0c4297544 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:52:53.716476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:53.716476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:53.716476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:53.716476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:53.716476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:53.716476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:53.716476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:53.716476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:53.716476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:53.716476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:53.716476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:53.716476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:53.716476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:53.716476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:53.716476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:53.717390 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:53.717390 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:53.717390 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:53.717390 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:53.717390 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:53.717390 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:53.717390 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:53.717390 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:53.717390 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:53.717390 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:53.717390 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:53.717390 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:52:53.717390 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:53.717390 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:53.717390 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:53.717390 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:53.718604 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:53.718604 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:53.718604 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:53.718604 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:53.718604 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:53.718604 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:53.718604 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:53.718604 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:53.718604 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:53.718604 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:53.718604 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:52:53.718604 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:52:53.718604 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 145/282] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:53.724185 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f146b-efa5-466e-ac0a-afcdfe3b0642 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:53.827106 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f146b-efa5-466e-ac0a-afcdfe3b0642 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:53.863158 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2dce8-c239-46b8-abcc-11feda6d588e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:53.863897 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2dce8-c239-46b8-abcc-11feda6d588e None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:53.864177 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2dce8-c239-46b8-abcc-11feda6d588e None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:53.864445 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2dce8-c239-46b8-abcc-11feda6d588e None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:53.865183 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2dce8-c239-46b8-abcc-11feda6d588e None admin] RBAC: Adding query filter params (name=reader) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:53.865483 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2dce8-c239-46b8-abcc-11feda6d588e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:53.866926 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2dce8-c239-46b8-abcc-11feda6d588e None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:53.876609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 138/283] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:52:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:52:53.882173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd1813-a172-431c-a938-52a0c4297544 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:54.030908 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd1813-a172-431c-a938-52a0c4297544 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:54.081094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f7686-353c-42b3-b342-832ee8770b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:54.082381 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f7686-353c-42b3-b342-832ee8770b03 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:54.082881 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f7686-353c-42b3-b342-832ee8770b03 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:54.083351 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f7686-353c-42b3-b342-832ee8770b03 None admin] PATH_INFO: `/v3/users/314b5a80eec4498c85ec5c484724af11` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:54.085306 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f7686-353c-42b3-b342-832ee8770b03 None admin] RBAC: Authorizing `identity:get_user(user_id=314b5a80eec4498c85ec5c484724af11)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:54.087205 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f7686-353c-42b3-b342-832ee8770b03 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:54.089395 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 146/284] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:53 2022] GET /identity/v3/users/314b5a80eec4498c85ec5c484724af11 => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:54.094535 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2dce8-c239-46b8-abcc-11feda6d588e None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:54.224733 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2dce8-c239-46b8-abcc-11feda6d588e None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:54.268186 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f449d5-90e2-4b94-adc6-04b82fcbc10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:54.269052 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f449d5-90e2-4b94-adc6-04b82fcbc10d None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:54.269327 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f449d5-90e2-4b94-adc6-04b82fcbc10d None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:54.269600 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f449d5-90e2-4b94-adc6-04b82fcbc10d None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:54.270782 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f449d5-90e2-4b94-adc6-04b82fcbc10d None admin] RBAC: Authorizing `identity:get_project(project_id=7de1a1d5d5f041ddbc5231b5975a3a68)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:54.272268 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f449d5-90e2-4b94-adc6-04b82fcbc10d None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:54.274249 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 139/285] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:54 2022] GET /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:54.279773 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f7686-353c-42b3-b342-832ee8770b03 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:54.397184 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f7686-353c-42b3-b342-832ee8770b03 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:54.446845 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5f413-d1e1-414f-bf2d-883ba2ae5a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:54.447932 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5f413-d1e1-414f-bf2d-883ba2ae5a75 None admin] REQUEST_METHOD: `PUT` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:54.448215 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5f413-d1e1-414f-bf2d-883ba2ae5a75 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:54.448490 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5f413-d1e1-414f-bf2d-883ba2ae5a75 None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68/users/314b5a80eec4498c85ec5c484724af11/roles/2088f05fbc394bb4a8b98c44c2af1309` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:54.452939 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5f413-d1e1-414f-bf2d-883ba2ae5a75 None admin] RBAC: Authorizing `identity:create_grant(project_id=7de1a1d5d5f041ddbc5231b5975a3a68, user_id=314b5a80eec4498c85ec5c484724af11, role_id=2088f05fbc394bb4a8b98c44c2af1309)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:54.454447 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5f413-d1e1-414f-bf2d-883ba2ae5a75 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:54.492529 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 147/286] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 12 16:52:54 2022] PUT /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68/users/314b5a80eec4498c85ec5c484724af11/roles/2088f05fbc394bb4a8b98c44c2af1309 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:52:54.776974 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f5c18-513b-4522-9f11-58c21d73f04b None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:54.777266 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f5c18-513b-4522-9f11-58c21d73f04b None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:54.777443 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f5c18-513b-4522-9f11-58c21d73f04b None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:54.779036 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 140/287] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:54.785405 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97acbc-2b23-4dd5-832b-ec9e45cc9ffc None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:54.785700 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97acbc-2b23-4dd5-832b-ec9e45cc9ffc None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:54.785980 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97acbc-2b23-4dd5-832b-ec9e45cc9ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:54.806160 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-2e97acbc-2b23-4dd5-832b-ec9e45cc9ffc None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:54.807350 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-2e97acbc-2b23-4dd5-832b-ec9e45cc9ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:54.894095 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 148/288] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:54.933263 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f5c18-513b-4522-9f11-58c21d73f04b None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:55.083241 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f5c18-513b-4522-9f11-58c21d73f04b None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:55.132968 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea929584-6e6b-44ea-b37d-afd79933ce8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:55.133779 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea929584-6e6b-44ea-b37d-afd79933ce8f None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:55.134063 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea929584-6e6b-44ea-b37d-afd79933ce8f None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:55.134338 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea929584-6e6b-44ea-b37d-afd79933ce8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:55.150027 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea929584-6e6b-44ea-b37d-afd79933ce8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:55.158172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-ea929584-6e6b-44ea-b37d-afd79933ce8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:55.158172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:55.158172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:55.158172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:55.158172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:55.158172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:55.158172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:55.158172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:55.158172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:55.158172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:55.158172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:55.158172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:55.158172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:55.158172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:55.158172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:55.158172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:55.159047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:55.159047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:55.159047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:55.159047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:55.159047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:55.159047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:55.159047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:55.159047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:55.159047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:55.159047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:55.159047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:55.159047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:52:55.159047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:55.159047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:55.159047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:55.159047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:55.159840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:55.159840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:55.159840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:55.159840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:55.159840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:55.159840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:55.159840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:55.159840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:55.159840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:55.159840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:55.159840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:55.159840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:52:55.163786 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 141/289] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:55.168743 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97acbc-2b23-4dd5-832b-ec9e45cc9ffc None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:55.306048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97acbc-2b23-4dd5-832b-ec9e45cc9ffc None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:55.350542 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8d713-a128-4dcf-914e-ffd69dd6c1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:55.351131 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8d713-a128-4dcf-914e-ffd69dd6c1a1 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:55.351664 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8d713-a128-4dcf-914e-ffd69dd6c1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:55.351947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8d713-a128-4dcf-914e-ffd69dd6c1a1 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:55.352688 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8d713-a128-4dcf-914e-ffd69dd6c1a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:55.352989 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8d713-a128-4dcf-914e-ffd69dd6c1a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:55.354364 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8d713-a128-4dcf-914e-ffd69dd6c1a1 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:55.370039 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 149/290] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:52:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:55.376151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea929584-6e6b-44ea-b37d-afd79933ce8f None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:55.495978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea929584-6e6b-44ea-b37d-afd79933ce8f None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:55.536368 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6557a3-12a1-48c4-9d5c-4371422aac38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:55.537240 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6557a3-12a1-48c4-9d5c-4371422aac38 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:55.537525 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6557a3-12a1-48c4-9d5c-4371422aac38 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:55.537849 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6557a3-12a1-48c4-9d5c-4371422aac38 None admin] PATH_INFO: `/v3/users/7df7388cd1744cb89570ad265380f6c6` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:55.539077 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6557a3-12a1-48c4-9d5c-4371422aac38 None admin] RBAC: Authorizing `identity:get_user(user_id=7df7388cd1744cb89570ad265380f6c6)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:55.540731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6557a3-12a1-48c4-9d5c-4371422aac38 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:55.542530 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 142/291] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:55 2022] GET /identity/v3/users/7df7388cd1744cb89570ad265380f6c6 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:55.548661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8d713-a128-4dcf-914e-ffd69dd6c1a1 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:55.696000 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8d713-a128-4dcf-914e-ffd69dd6c1a1 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:55.735229 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b4968-24dc-41bc-9ef9-735369911f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:55.735906 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b4968-24dc-41bc-9ef9-735369911f9b None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:55.736188 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b4968-24dc-41bc-9ef9-735369911f9b None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:55.736511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b4968-24dc-41bc-9ef9-735369911f9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:55.803824 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b4968-24dc-41bc-9ef9-735369911f9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:55.805293 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b4968-24dc-41bc-9ef9-735369911f9b None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:55.922854 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 150/292] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:52:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:52:55.932753 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6557a3-12a1-48c4-9d5c-4371422aac38 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:56.047698 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6557a3-12a1-48c4-9d5c-4371422aac38 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:56.087405 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75d5a5-153e-4d2e-8be4-3bc10b78b4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:56.088330 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75d5a5-153e-4d2e-8be4-3bc10b78b4a4 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:56.088612 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75d5a5-153e-4d2e-8be4-3bc10b78b4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:56.088889 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75d5a5-153e-4d2e-8be4-3bc10b78b4a4 None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:56.090173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75d5a5-153e-4d2e-8be4-3bc10b78b4a4 None admin] RBAC: Authorizing `identity:get_project(project_id=7de1a1d5d5f041ddbc5231b5975a3a68)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:56.091699 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75d5a5-153e-4d2e-8be4-3bc10b78b4a4 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:56.093507 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 143/293] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:55 2022] GET /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:56.100550 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b4968-24dc-41bc-9ef9-735369911f9b None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:56.239477 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b4968-24dc-41bc-9ef9-735369911f9b None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:56.287571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476d547-33cc-4860-ae17-fc427d41a336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:56.288285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476d547-33cc-4860-ae17-fc427d41a336 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:56.288563 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476d547-33cc-4860-ae17-fc427d41a336 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:56.288836 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476d547-33cc-4860-ae17-fc427d41a336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:56.289424 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bf191-f03e-4f66-8437-28e018985153 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:56.289858 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476d547-33cc-4860-ae17-fc427d41a336 None admin] RBAC: Adding query filter params (role.id=0474b158b4bc4046ac169d53fff04721, scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68, user.id=7df7388cd1744cb89570ad265380f6c6) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:56.290041 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476d547-33cc-4860-ae17-fc427d41a336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:56.290515 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bf191-f03e-4f66-8437-28e018985153 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:56.291003 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bf191-f03e-4f66-8437-28e018985153 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:56.291487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476d547-33cc-4860-ae17-fc427d41a336 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:56.298833 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 151/294] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:52:56 2022] GET /identity/v3/role_assignments?user.id=7df7388cd1744cb89570ad265380f6c6&scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68&role.id=0474b158b4bc4046ac169d53fff04721 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:56.303553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 144/295] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:56 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:56.305849 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b8096-e96a-4c6f-8d1d-d8fe0e576563 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:56.306426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b8096-e96a-4c6f-8d1d-d8fe0e576563 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:56.306921 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b8096-e96a-4c6f-8d1d-d8fe0e576563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:56.330525 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-c59b8096-e96a-4c6f-8d1d-d8fe0e576563 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:56.332207 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-c59b8096-e96a-4c6f-8d1d-d8fe0e576563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:56.429820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 152/296] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:56.478459 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bf191-f03e-4f66-8437-28e018985153 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:56.485190 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d000f0-2081-4adc-adf8-27b925793626 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:56.485475 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d000f0-2081-4adc-adf8-27b925793626 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:56.485759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d000f0-2081-4adc-adf8-27b925793626 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:56.487170 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 153/297] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:56.493001 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3678b52-4058-4818-b4d9-008f0ed015ed None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:56.493432 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3678b52-4058-4818-b4d9-008f0ed015ed None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:56.493817 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3678b52-4058-4818-b4d9-008f0ed015ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:56.516564 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-d3678b52-4058-4818-b4d9-008f0ed015ed None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:56.517772 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-d3678b52-4058-4818-b4d9-008f0ed015ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:56.619581 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 154/298] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:52:56.620845 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982c89b-7c66-4c90-bfaa-5cdb0c5044a6 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:56.621139 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982c89b-7c66-4c90-bfaa-5cdb0c5044a6 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:56.621413 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982c89b-7c66-4c90-bfaa-5cdb0c5044a6 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:56.622775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 155/299] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:56.624363 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bf191-f03e-4f66-8437-28e018985153 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:56.628308 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb4f3a-207a-4268-83d8-859155fdc079 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:56.628595 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb4f3a-207a-4268-83d8-859155fdc079 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:56.628878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb4f3a-207a-4268-83d8-859155fdc079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:56.644995 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-d1fb4f3a-207a-4268-83d8-859155fdc079 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:56.646173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-d1fb4f3a-207a-4268-83d8-859155fdc079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:56.665870 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de69e8-163b-47ac-88b1-537fa0ff3270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:56.666661 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de69e8-163b-47ac-88b1-537fa0ff3270 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:56.666941 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de69e8-163b-47ac-88b1-537fa0ff3270 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:56.667210 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de69e8-163b-47ac-88b1-537fa0ff3270 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:56.680281 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de69e8-163b-47ac-88b1-537fa0ff3270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:56.689156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-61de69e8-163b-47ac-88b1-537fa0ff3270 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:52:56.689156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:56.689156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:56.689156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:56.689156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:56.689156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:56.689156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:56.689156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:56.689156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:56.689156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:56.689156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:56.689156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:56.689156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:56.689156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:56.689156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:56.689156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:56.690204 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:56.690204 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:56.690204 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:56.690204 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:56.690204 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:56.690204 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:56.690204 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:56.690204 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:56.690204 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:56.690204 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:56.690204 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:56.690204 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:52:56.690204 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:56.690204 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:56.690204 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:56.690204 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:56.691089 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:56.691089 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:56.691089 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:56.691089 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:56.691089 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:56.691089 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:56.691089 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:56.691089 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:56.691089 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:56.691089 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:56.691089 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:52:56.691089 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:52:56.691089 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 145/300] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:56.691089 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de69e8-163b-47ac-88b1-537fa0ff3270 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:56.728427 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 156/301] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:52:56.729125 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb4f3a-207a-4268-83d8-859155fdc079 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:56.800456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de69e8-163b-47ac-88b1-537fa0ff3270 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:56.830318 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb4f3a-207a-4268-83d8-859155fdc079 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:56.834584 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2b5cd-3c04-462b-8580-77963c31c0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:56.835376 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2b5cd-3c04-462b-8580-77963c31c0b3 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:56.835680 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2b5cd-3c04-462b-8580-77963c31c0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:56.835957 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2b5cd-3c04-462b-8580-77963c31c0b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:56.846999 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2b5cd-3c04-462b-8580-77963c31c0b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:56.855009 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-66c2b5cd-3c04-462b-8580-77963c31c0b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:56.855009 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:56.855009 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:56.855009 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:56.855009 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:56.855009 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:56.855009 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:56.855009 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:56.855009 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:56.855009 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:56.855009 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:56.855009 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:56.855009 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:56.855009 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:56.855009 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:56.855009 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:56.855954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:56.855954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:56.855954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:56.855954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:56.855954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:56.855954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:56.855954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:56.855954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:56.855954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:56.855954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:56.855954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:56.855954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:52:56.855954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:56.855954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:56.855954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:56.855954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:56.856740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:56.856740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:56.856740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:56.856740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:56.856740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:56.856740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:56.856740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:56.856740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:56.856740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:56.856740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:56.856740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:52:56.856740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:52:56.856740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 146/302] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:56.857394 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2b5cd-3c04-462b-8580-77963c31c0b3 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:56.869714 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4d5fb-0813-4f17-9e09-6928f10d302c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:56.870306 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4d5fb-0813-4f17-9e09-6928f10d302c None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:56.870587 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4d5fb-0813-4f17-9e09-6928f10d302c None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:56.870861 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4d5fb-0813-4f17-9e09-6928f10d302c None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:56.871611 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4d5fb-0813-4f17-9e09-6928f10d302c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:56.871950 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4d5fb-0813-4f17-9e09-6928f10d302c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:56.873328 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4d5fb-0813-4f17-9e09-6928f10d302c None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:56.886090 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 157/303] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:52:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:56.886743 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4d5fb-0813-4f17-9e09-6928f10d302c None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:56.964198 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2b5cd-3c04-462b-8580-77963c31c0b3 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:56.987188 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4d5fb-0813-4f17-9e09-6928f10d302c None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:57.001029 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b6cf0-d3db-4779-b5bc-04f4484607ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:57.002112 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b6cf0-d3db-4779-b5bc-04f4484607ea None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:57.002398 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b6cf0-d3db-4779-b5bc-04f4484607ea None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:57.002827 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b6cf0-d3db-4779-b5bc-04f4484607ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:57.004323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b6cf0-d3db-4779-b5bc-04f4484607ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:57.005797 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b6cf0-d3db-4779-b5bc-04f4484607ea None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:57.012933 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 147/304] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:52:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:57.012933 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b6cf0-d3db-4779-b5bc-04f4484607ea None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:57.020437 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98d066-95be-492a-9e14-170d860a8b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:57.021104 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98d066-95be-492a-9e14-170d860a8b2b None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:57.021389 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98d066-95be-492a-9e14-170d860a8b2b None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:57.021667 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98d066-95be-492a-9e14-170d860a8b2b None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:57.022587 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98d066-95be-492a-9e14-170d860a8b2b None admin] RBAC: Adding query filter params (name=member) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:57.022900 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98d066-95be-492a-9e14-170d860a8b2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:57.024332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98d066-95be-492a-9e14-170d860a8b2b None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:57.037626 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 158/305] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:52:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:57.037626 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98d066-95be-492a-9e14-170d860a8b2b None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:57.110431 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b6cf0-d3db-4779-b5bc-04f4484607ea None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:57.135228 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98d066-95be-492a-9e14-170d860a8b2b None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:57.143556 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c45d4-a179-4630-a7cc-25cf2762cc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:57.145041 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c45d4-a179-4630-a7cc-25cf2762cc04 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:57.145778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c45d4-a179-4630-a7cc-25cf2762cc04 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:57.146410 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c45d4-a179-4630-a7cc-25cf2762cc04 None admin] PATH_INFO: `/v3/users/2604f655e47e4c93a1ba79dd3901bed9` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:57.163043 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c45d4-a179-4630-a7cc-25cf2762cc04 None admin] RBAC: Authorizing `identity:get_user(user_id=2604f655e47e4c93a1ba79dd3901bed9)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:57.164558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c45d4-a179-4630-a7cc-25cf2762cc04 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:57.170985 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 148/306] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:57 2022] GET /identity/v3/users/2604f655e47e4c93a1ba79dd3901bed9 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:57.170985 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c45d4-a179-4630-a7cc-25cf2762cc04 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:57.174282 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42052253-7b2f-44d4-b033-cd096b13e0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:57.175342 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42052253-7b2f-44d4-b033-cd096b13e0a3 None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:57.175342 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42052253-7b2f-44d4-b033-cd096b13e0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:57.175503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42052253-7b2f-44d4-b033-cd096b13e0a3 None admin] PATH_INFO: `/v3/groups` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:57.176223 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42052253-7b2f-44d4-b033-cd096b13e0a3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:57.177687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42052253-7b2f-44d4-b033-cd096b13e0a3 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:57.194580 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 159/307] 10.222.0.64 () {60 vars in 1134 bytes} [Thu May 12 16:52:57 2022] POST /identity/v3/groups => generated 229 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:52:57.195732 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42052253-7b2f-44d4-b033-cd096b13e0a3 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:57.272812 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c45d4-a179-4630-a7cc-25cf2762cc04 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:57.311477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35eda21-4fd1-4c7c-85e4-88eb35588bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:57.312964 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eda21-4fd1-4c7c-85e4-88eb35588bf4 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:57.313249 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eda21-4fd1-4c7c-85e4-88eb35588bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:57.313524 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eda21-4fd1-4c7c-85e4-88eb35588bf4 None admin] PATH_INFO: `/v3/users/9844c451143647c992be7c4ac7699570` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:57.314944 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35eda21-4fd1-4c7c-85e4-88eb35588bf4 None admin] RBAC: Authorizing `identity:get_user(user_id=9844c451143647c992be7c4ac7699570)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:57.316502 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35eda21-4fd1-4c7c-85e4-88eb35588bf4 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:57.318319 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 149/308] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:57 2022] GET /identity/v3/users/9844c451143647c992be7c4ac7699570 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:57.324403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35eda21-4fd1-4c7c-85e4-88eb35588bf4 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:57.333852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42052253-7b2f-44d4-b033-cd096b13e0a3 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:57.371952 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f007c0-2cc0-4be5-ac48-bb0e2efd606f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:57.373047 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f007c0-2cc0-4be5-ac48-bb0e2efd606f None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:57.373537 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f007c0-2cc0-4be5-ac48-bb0e2efd606f None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:57.374018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f007c0-2cc0-4be5-ac48-bb0e2efd606f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:57.375625 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f007c0-2cc0-4be5-ac48-bb0e2efd606f None admin] RBAC: Adding query filter params (role.id=2088f05fbc394bb4a8b98c44c2af1309, user.id=2604f655e47e4c93a1ba79dd3901bed9, scope.system=all) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:57.376199 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f007c0-2cc0-4be5-ac48-bb0e2efd606f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:57.378021 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f007c0-2cc0-4be5-ac48-bb0e2efd606f None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:57.388153 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 160/309] 10.222.0.64 () {56 vars in 1308 bytes} [Thu May 12 16:52:57 2022] GET /identity/v3/role_assignments?user.id=2604f655e47e4c93a1ba79dd3901bed9&scope.system=all&role.id=2088f05fbc394bb4a8b98c44c2af1309 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:57.435107 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35eda21-4fd1-4c7c-85e4-88eb35588bf4 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:57.476136 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5089e0a-79a2-49ef-974b-fb9dc4910b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:57.477272 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5089e0a-79a2-49ef-974b-fb9dc4910b94 None admin] REQUEST_METHOD: `PUT` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:57.477557 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5089e0a-79a2-49ef-974b-fb9dc4910b94 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:57.477831 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5089e0a-79a2-49ef-974b-fb9dc4910b94 None admin] PATH_INFO: `/v3/system/users/9844c451143647c992be7c4ac7699570/roles/0474b158b4bc4046ac169d53fff04721` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:57.479511 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5089e0a-79a2-49ef-974b-fb9dc4910b94 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9844c451143647c992be7c4ac7699570, role_id=0474b158b4bc4046ac169d53fff04721)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:57.480959 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5089e0a-79a2-49ef-974b-fb9dc4910b94 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:57.492767 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb81433-3ac3-4e59-9fd5-d418cfedd142 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:57.493064 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb81433-3ac3-4e59-9fd5-d418cfedd142 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:57.493317 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb81433-3ac3-4e59-9fd5-d418cfedd142 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:57.493674 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 150/310] 10.222.0.64 () {58 vars in 1334 bytes} [Thu May 12 16:52:57 2022] PUT /identity/v3/system/users/9844c451143647c992be7c4ac7699570/roles/0474b158b4bc4046ac169d53fff04721 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 16:52:57.494699 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 161/311] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:52:57.501157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe65b9-7167-423a-ad28-662f78d75b5f None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:57.501457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe65b9-7167-423a-ad28-662f78d75b5f None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:57.501683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe65b9-7167-423a-ad28-662f78d75b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:57.521557 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-15fe65b9-7167-423a-ad28-662f78d75b5f None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:57.522916 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-15fe65b9-7167-423a-ad28-662f78d75b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:57.652540 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 151/312] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:57.677546 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb81433-3ac3-4e59-9fd5-d418cfedd142 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:57.829212 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb81433-3ac3-4e59-9fd5-d418cfedd142 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:57.864641 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae03c4b-e680-412c-bf45-e505a1ab3b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:57.865442 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae03c4b-e680-412c-bf45-e505a1ab3b79 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:57.865721 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae03c4b-e680-412c-bf45-e505a1ab3b79 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:57.865989 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae03c4b-e680-412c-bf45-e505a1ab3b79 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:57.877047 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae03c4b-e680-412c-bf45-e505a1ab3b79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:52:57.884867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-7ae03c4b-e680-412c-bf45-e505a1ab3b79 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:52:57.884867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:52:57.884867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:52:57.884867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:52:57.884867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:52:57.884867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:52:57.884867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:52:57.884867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:52:57.884867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:52:57.884867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:52:57.884867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:52:57.884867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:52:57.884867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:52:57.884867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:52:57.884867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:52:57.884867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:52:57.885741 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:52:57.885741 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:52:57.885741 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:52:57.885741 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:52:57.885741 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:52:57.885741 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:52:57.885741 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:52:57.885741 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:52:57.885741 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:52:57.885741 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:52:57.885741 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:52:57.885741 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:52:57.885741 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:52:57.885741 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:52:57.885741 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:52:57.885741 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:52:57.886503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:52:57.886503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:52:57.886503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:52:57.886503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:52:57.886503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:52:57.886503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:52:57.886503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:52:57.886503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:52:57.886503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:52:57.886503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:52:57.886503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:52:57.886503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:52:57.886503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 162/313] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:52:57.892067 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe65b9-7167-423a-ad28-662f78d75b5f None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:57.991091 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe65b9-7167-423a-ad28-662f78d75b5f None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:58.024564 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995ecd5-529d-4dff-8df9-57df74f85da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:58.025280 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995ecd5-529d-4dff-8df9-57df74f85da7 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:58.025560 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995ecd5-529d-4dff-8df9-57df74f85da7 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:58.025831 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995ecd5-529d-4dff-8df9-57df74f85da7 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:58.026567 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995ecd5-529d-4dff-8df9-57df74f85da7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:58.026866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995ecd5-529d-4dff-8df9-57df74f85da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:58.028260 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995ecd5-529d-4dff-8df9-57df74f85da7 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:58.037356 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 152/314] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:52:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:58.042595 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae03c4b-e680-412c-bf45-e505a1ab3b79 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:58.147454 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae03c4b-e680-412c-bf45-e505a1ab3b79 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:58.181047 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d6a82-8691-4de8-9924-1de1bd5a505d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:58.181846 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d6a82-8691-4de8-9924-1de1bd5a505d None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:58.182125 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d6a82-8691-4de8-9924-1de1bd5a505d None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:58.182396 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d6a82-8691-4de8-9924-1de1bd5a505d None admin] PATH_INFO: `/v3/users/314b5a80eec4498c85ec5c484724af11` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:58.183605 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d6a82-8691-4de8-9924-1de1bd5a505d None admin] RBAC: Authorizing `identity:get_user(user_id=314b5a80eec4498c85ec5c484724af11)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:58.185085 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d6a82-8691-4de8-9924-1de1bd5a505d None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:58.187032 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 163/315] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:52:58 2022] GET /identity/v3/users/314b5a80eec4498c85ec5c484724af11 => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:58.192186 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995ecd5-529d-4dff-8df9-57df74f85da7 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:58.290121 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995ecd5-529d-4dff-8df9-57df74f85da7 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:58.323296 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222efb4-9fe3-4474-af1f-20ae56187aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:58.323970 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222efb4-9fe3-4474-af1f-20ae56187aa2 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:58.324249 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222efb4-9fe3-4474-af1f-20ae56187aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:58.324521 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222efb4-9fe3-4474-af1f-20ae56187aa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:58.391113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222efb4-9fe3-4474-af1f-20ae56187aa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:58.392596 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3222efb4-9fe3-4474-af1f-20ae56187aa2 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:58.493014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 153/316] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:52:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:52:58.498412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d6a82-8691-4de8-9924-1de1bd5a505d None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:58.608211 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d6a82-8691-4de8-9924-1de1bd5a505d None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:58.643477 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de589e-9a2c-4a5b-b727-53e9ed5277bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:58.644383 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de589e-9a2c-4a5b-b727-53e9ed5277bf None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:58.644742 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de589e-9a2c-4a5b-b727-53e9ed5277bf None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:58.645028 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de589e-9a2c-4a5b-b727-53e9ed5277bf None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:58.646222 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de589e-9a2c-4a5b-b727-53e9ed5277bf None admin] RBAC: Authorizing `identity:get_project(project_id=7de1a1d5d5f041ddbc5231b5975a3a68)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:58.647717 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de589e-9a2c-4a5b-b727-53e9ed5277bf None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:58.649926 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 164/317] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:52:58 2022] GET /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:58.656061 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222efb4-9fe3-4474-af1f-20ae56187aa2 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:58.756528 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3222efb4-9fe3-4474-af1f-20ae56187aa2 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:58.792497 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f531d2e-24a1-45a8-9fe3-3bdcd514e6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:58.793499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f531d2e-24a1-45a8-9fe3-3bdcd514e6c0 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:58.793978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f531d2e-24a1-45a8-9fe3-3bdcd514e6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:58.794446 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f531d2e-24a1-45a8-9fe3-3bdcd514e6c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:58.795483 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f531d2e-24a1-45a8-9fe3-3bdcd514e6c0 None admin] RBAC: Adding query filter params (role.id=2088f05fbc394bb4a8b98c44c2af1309, scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68, user.id=314b5a80eec4498c85ec5c484724af11) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:52:58.796026 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f531d2e-24a1-45a8-9fe3-3bdcd514e6c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:58.797709 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f531d2e-24a1-45a8-9fe3-3bdcd514e6c0 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:58.804252 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 154/318] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:52:58 2022] GET /identity/v3/role_assignments?user.id=314b5a80eec4498c85ec5c484724af11&scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68&role.id=2088f05fbc394bb4a8b98c44c2af1309 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:59.619850 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd94e50-0bf9-4931-8343-0f2f441c6393 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:59.620416 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd94e50-0bf9-4931-8343-0f2f441c6393 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:59.620416 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd94e50-0bf9-4931-8343-0f2f441c6393 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:59.621986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 165/319] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:52:59.627375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc380d60-d8cb-4d9b-b8f3-79366164f415 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:59.627862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc380d60-d8cb-4d9b-b8f3-79366164f415 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:59.628053 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc380d60-d8cb-4d9b-b8f3-79366164f415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:59.644938 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-fc380d60-d8cb-4d9b-b8f3-79366164f415 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:59.646112 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-fc380d60-d8cb-4d9b-b8f3-79366164f415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:59.710662 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 155/320] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:52:59.734072 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd94e50-0bf9-4931-8343-0f2f441c6393 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:59.788284 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc8105-061c-4738-9e44-95d34436817f None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:59.788579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc8105-061c-4738-9e44-95d34436817f None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:59.788862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc8105-061c-4738-9e44-95d34436817f None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:59.790703 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 156/321] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:52:59.795649 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9bd97-6527-4cfb-b56e-8c41c5d6aec6 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:59.795961 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9bd97-6527-4cfb-b56e-8c41c5d6aec6 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:59.796238 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9bd97-6527-4cfb-b56e-8c41c5d6aec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:59.813500 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-97e9bd97-6527-4cfb-b56e-8c41c5d6aec6 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:52:59.814699 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-97e9bd97-6527-4cfb-b56e-8c41c5d6aec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:52:59.848332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd94e50-0bf9-4931-8343-0f2f441c6393 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:52:59.888227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db541169-255a-4435-99f3-3665a323a0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:52:59.889252 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db541169-255a-4435-99f3-3665a323a0b2 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:52:59.889680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db541169-255a-4435-99f3-3665a323a0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:52:59.890098 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db541169-255a-4435-99f3-3665a323a0b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:52:59.891989 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db541169-255a-4435-99f3-3665a323a0b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:52:59.893674 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db541169-255a-4435-99f3-3665a323a0b2 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:52:59.895763 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 166/322] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:52:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:52:59.899902 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 157/323] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:52:59.900942 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db541169-255a-4435-99f3-3665a323a0b2 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:52:59.915323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9bd97-6527-4cfb-b56e-8c41c5d6aec6 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:00.000603 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db541169-255a-4435-99f3-3665a323a0b2 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:00.007518 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9bd97-6527-4cfb-b56e-8c41c5d6aec6 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:00.032302 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffd5b2-1634-4c24-949e-56c35c14a305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:00.032958 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffd5b2-1634-4c24-949e-56c35c14a305 None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:00.033240 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffd5b2-1634-4c24-949e-56c35c14a305 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:00.033516 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffd5b2-1634-4c24-949e-56c35c14a305 None admin] PATH_INFO: `/v3/groups` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:00.034196 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bffd5b2-1634-4c24-949e-56c35c14a305 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:00.035670 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bffd5b2-1634-4c24-949e-56c35c14a305 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:00.040155 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca90ba9-e9be-4139-b481-a0d9b177d7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:00.040976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca90ba9-e9be-4139-b481-a0d9b177d7bc None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:00.041235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca90ba9-e9be-4139-b481-a0d9b177d7bc None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:00.041499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca90ba9-e9be-4139-b481-a0d9b177d7bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:00.048933 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 167/324] 10.222.0.64 () {60 vars in 1134 bytes} [Thu May 12 16:52:59 2022] POST /identity/v3/groups => generated 226 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:53:00.063932 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ced6f-cdb2-4527-bc33-f9de8d0c0ab8 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:00.063932 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ced6f-cdb2-4527-bc33-f9de8d0c0ab8 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:00.063932 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ced6f-cdb2-4527-bc33-f9de8d0c0ab8 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:00.063932 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 168/325] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:00.064211 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca90ba9-e9be-4139-b481-a0d9b177d7bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:00.064290 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4fb37-0a66-4adb-90b2-e86c35ac3279 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:00.064290 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4fb37-0a66-4adb-90b2-e86c35ac3279 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:00.064290 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4fb37-0a66-4adb-90b2-e86c35ac3279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:00.064499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-6ca90ba9-e9be-4139-b481-a0d9b177d7bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:53:00.064499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:00.064499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:00.064499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:00.064499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:00.064499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:00.064499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:00.064499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:00.064499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:00.064499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:00.064499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:00.064499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:00.064499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:00.064499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:00.064499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:00.064499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:00.065477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:00.065477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:00.065477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:00.065477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:00.065477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:00.065477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:00.065477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:00.065477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:00.065477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:00.065477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:00.065477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:00.065477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:00.065477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:00.065477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:00.065477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:00.065477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:00.066437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:00.066437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:00.066437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:00.066437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:00.066437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:00.066437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:00.066437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:00.066437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:00.066437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:00.066437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:00.066437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:53:00.066437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:00.066437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 158/326] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:52:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:00.067348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca90ba9-e9be-4139-b481-a0d9b177d7bc None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:00.076912 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-2ac4fb37-0a66-4adb-90b2-e86c35ac3279 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:00.078698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-2ac4fb37-0a66-4adb-90b2-e86c35ac3279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:00.151759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 169/327] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:53:00.176574 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4fb37-0a66-4adb-90b2-e86c35ac3279 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:00.188796 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca90ba9-e9be-4139-b481-a0d9b177d7bc None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:00.230233 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797a6d7-1a30-457c-a68f-03162f72d184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:00.231218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797a6d7-1a30-457c-a68f-03162f72d184 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:00.231670 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797a6d7-1a30-457c-a68f-03162f72d184 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:00.232114 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a797a6d7-1a30-457c-a68f-03162f72d184 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:00.233052 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797a6d7-1a30-457c-a68f-03162f72d184 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:00.233360 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797a6d7-1a30-457c-a68f-03162f72d184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:00.234809 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a797a6d7-1a30-457c-a68f-03162f72d184 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:00.243505 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 159/328] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:53:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:00.249544 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797a6d7-1a30-457c-a68f-03162f72d184 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:00.282754 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4fb37-0a66-4adb-90b2-e86c35ac3279 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:00.329489 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a642a-bb93-472b-98a8-b1958759e11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:00.330251 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a642a-bb93-472b-98a8-b1958759e11b None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:00.330552 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a642a-bb93-472b-98a8-b1958759e11b None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:00.330790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a642a-bb93-472b-98a8-b1958759e11b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:00.344367 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a642a-bb93-472b-98a8-b1958759e11b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:00.352771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-325a642a-bb93-472b-98a8-b1958759e11b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:53:00.352771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:00.352771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:00.352771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:00.352771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:00.352771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:00.352771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:00.352771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:00.352771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:00.352771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:00.352771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:00.352771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:00.352771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:00.352771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:00.352771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:00.352771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:00.353651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:00.353651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:00.353651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:00.353651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:00.353651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:00.353651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:00.353651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:00.353651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:00.353651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:00.353651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:00.353651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:00.353651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:00.353651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:00.353651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:00.353651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:00.353651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:00.354415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:00.354415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:00.354415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:00.354415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:00.354415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:00.354415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:00.354415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:00.354415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:00.354415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:00.354415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:00.354415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:53:00.354415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:00.355453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 170/329] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:53:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:53:00.357015 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a797a6d7-1a30-457c-a68f-03162f72d184 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:00.361394 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a642a-bb93-472b-98a8-b1958759e11b None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:00.393736 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58596ee-3274-4744-b692-4c0ae49a5828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:00.394617 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58596ee-3274-4744-b692-4c0ae49a5828 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:00.394901 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58596ee-3274-4744-b692-4c0ae49a5828 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:00.395176 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58596ee-3274-4744-b692-4c0ae49a5828 None admin] PATH_INFO: `/v3/users/2604f655e47e4c93a1ba79dd3901bed9` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:00.396437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58596ee-3274-4744-b692-4c0ae49a5828 None admin] RBAC: Authorizing `identity:get_user(user_id=2604f655e47e4c93a1ba79dd3901bed9)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:00.397906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58596ee-3274-4744-b692-4c0ae49a5828 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:00.399743 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 160/330] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:53:00 2022] GET /identity/v3/users/2604f655e47e4c93a1ba79dd3901bed9 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:00.405179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58596ee-3274-4744-b692-4c0ae49a5828 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:00.463181 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a642a-bb93-472b-98a8-b1958759e11b None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:00.513083 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e77e7-1b65-4a27-9202-e87de2873ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:00.514182 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e77e7-1b65-4a27-9202-e87de2873ab0 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:00.514817 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e77e7-1b65-4a27-9202-e87de2873ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:00.515924 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e77e7-1b65-4a27-9202-e87de2873ab0 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:00.516814 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e77e7-1b65-4a27-9202-e87de2873ab0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:00.517135 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e77e7-1b65-4a27-9202-e87de2873ab0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:00.518552 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e77e7-1b65-4a27-9202-e87de2873ab0 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:00.525353 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58596ee-3274-4744-b692-4c0ae49a5828 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:00.530702 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 171/331] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:53:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:00.536110 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e77e7-1b65-4a27-9202-e87de2873ab0 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:00.564926 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17ad62-a51f-4f1d-8c09-7c944007facc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:00.565795 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17ad62-a51f-4f1d-8c09-7c944007facc None admin] REQUEST_METHOD: `PUT` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:00.566070 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17ad62-a51f-4f1d-8c09-7c944007facc None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:00.566347 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17ad62-a51f-4f1d-8c09-7c944007facc None admin] PATH_INFO: `/v3/system/users/2604f655e47e4c93a1ba79dd3901bed9/roles/2088f05fbc394bb4a8b98c44c2af1309` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:00.567869 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17ad62-a51f-4f1d-8c09-7c944007facc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2604f655e47e4c93a1ba79dd3901bed9, role_id=2088f05fbc394bb4a8b98c44c2af1309)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:00.569267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17ad62-a51f-4f1d-8c09-7c944007facc None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:00.584812 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 161/332] 10.222.0.64 () {58 vars in 1334 bytes} [Thu May 12 16:53:00 2022] PUT /identity/v3/system/users/2604f655e47e4c93a1ba79dd3901bed9/roles/2088f05fbc394bb4a8b98c44c2af1309 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 16:53:00.664306 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e77e7-1b65-4a27-9202-e87de2873ab0 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:00.704299 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d2c96-2b4e-4ee6-bc38-5f1b2f39b1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:00.705608 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d2c96-2b4e-4ee6-bc38-5f1b2f39b1eb None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:00.706140 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d2c96-2b4e-4ee6-bc38-5f1b2f39b1eb None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:00.706616 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d2c96-2b4e-4ee6-bc38-5f1b2f39b1eb None admin] PATH_INFO: `/v3/users/9844c451143647c992be7c4ac7699570` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:00.709008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d2c96-2b4e-4ee6-bc38-5f1b2f39b1eb None admin] RBAC: Authorizing `identity:get_user(user_id=9844c451143647c992be7c4ac7699570)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:00.710737 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d2c96-2b4e-4ee6-bc38-5f1b2f39b1eb None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:00.713043 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 172/333] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:53:00 2022] GET /identity/v3/users/9844c451143647c992be7c4ac7699570 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:00.719319 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17ad62-a51f-4f1d-8c09-7c944007facc None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:00.839323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17ad62-a51f-4f1d-8c09-7c944007facc None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:00.879865 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1745256-eafd-4015-9881-930c0757fe9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:00.880540 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1745256-eafd-4015-9881-930c0757fe9e None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:00.880902 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1745256-eafd-4015-9881-930c0757fe9e None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:00.881195 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1745256-eafd-4015-9881-930c0757fe9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:00.882732 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1745256-eafd-4015-9881-930c0757fe9e None admin] RBAC: Adding query filter params (role.id=0474b158b4bc4046ac169d53fff04721, user.id=9844c451143647c992be7c4ac7699570, scope.system=all) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:00.883148 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1745256-eafd-4015-9881-930c0757fe9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:00.884873 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1745256-eafd-4015-9881-930c0757fe9e None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:00.899561 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 162/334] 10.222.0.64 () {56 vars in 1308 bytes} [Thu May 12 16:53:00 2022] GET /identity/v3/role_assignments?user.id=9844c451143647c992be7c4ac7699570&scope.system=all&role.id=0474b158b4bc4046ac169d53fff04721 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:03.465982 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c32184-97ae-4724-b282-51208c33d8a4 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:03.467045 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c32184-97ae-4724-b282-51208c33d8a4 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:03.467542 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c32184-97ae-4724-b282-51208c33d8a4 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:03.470006 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 173/335] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:03.475178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bd7eb-eb8d-400b-8b06-6312680b3f13 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:03.476104 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bd7eb-eb8d-400b-8b06-6312680b3f13 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:03.476843 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bd7eb-eb8d-400b-8b06-6312680b3f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:03.500622 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-743bd7eb-eb8d-400b-8b06-6312680b3f13 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:03.502212 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-743bd7eb-eb8d-400b-8b06-6312680b3f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:03.601948 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 163/336] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:03.630078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4b36f-ea70-444d-9955-8d9da1c39e05 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:03.630707 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4b36f-ea70-444d-9955-8d9da1c39e05 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:03.631208 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4b36f-ea70-444d-9955-8d9da1c39e05 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:03.633111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 174/337] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:03.638240 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d701fe8-b19d-41f2-a8f1-d4ccdf05980c None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:03.638753 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d701fe8-b19d-41f2-a8f1-d4ccdf05980c None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:03.639244 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d701fe8-b19d-41f2-a8f1-d4ccdf05980c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:03.644445 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4b36f-ea70-444d-9955-8d9da1c39e05 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:03.665691 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-9d701fe8-b19d-41f2-a8f1-d4ccdf05980c None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:03.667323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-9d701fe8-b19d-41f2-a8f1-d4ccdf05980c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:03.752729 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 164/338] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:03.753860 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d57816-a505-46a7-845e-0be43f1a5718 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:03.754153 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d57816-a505-46a7-845e-0be43f1a5718 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:03.754431 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d57816-a505-46a7-845e-0be43f1a5718 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:03.755886 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 165/339] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:03.770646 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4b36f-ea70-444d-9955-8d9da1c39e05 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:03.773193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e687c-ef2f-4e4b-b117-840a54a0edab None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:03.773483 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e687c-ef2f-4e4b-b117-840a54a0edab None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:03.773764 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e687c-ef2f-4e4b-b117-840a54a0edab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:03.802888 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-718e687c-ef2f-4e4b-b117-840a54a0edab None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:03.804383 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-718e687c-ef2f-4e4b-b117-840a54a0edab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:03.809836 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de07012-ad3e-43fa-99c8-2be31f2db1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:03.810512 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de07012-ad3e-43fa-99c8-2be31f2db1dc None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:03.810791 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de07012-ad3e-43fa-99c8-2be31f2db1dc None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:03.811066 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de07012-ad3e-43fa-99c8-2be31f2db1dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:03.836423 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de07012-ad3e-43fa-99c8-2be31f2db1dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:03.850680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-5de07012-ad3e-43fa-99c8-2be31f2db1dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:53:03.850680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:03.850680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:03.850680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:03.850680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:03.850680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:03.850680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:03.850680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:03.850680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:03.850680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:03.850680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:03.850680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:03.850680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:03.850680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:03.850680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:03.850680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:03.851991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:03.851991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:03.851991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:03.851991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:03.851991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:03.851991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:03.851991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:03.851991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:03.851991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:03.851991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:03.851991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:03.851991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:03.851991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:03.851991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:03.851991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:03.851991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:03.853239 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:03.853239 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:03.853239 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:03.853239 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:03.853239 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:03.853239 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:03.853239 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:03.853239 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:03.853239 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:03.853239 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:03.853239 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:53:03.853239 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:03.853239 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 175/340] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:53:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:03.854853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de07012-ad3e-43fa-99c8-2be31f2db1dc None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:03.922879 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 166/341] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:53:03.924202 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f526136-c0b4-42d0-8117-774e4195a362 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:03.924202 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f526136-c0b4-42d0-8117-774e4195a362 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:03.924406 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f526136-c0b4-42d0-8117-774e4195a362 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:03.925777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 167/342] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:03.926282 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f526136-c0b4-42d0-8117-774e4195a362 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:03.988236 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de07012-ad3e-43fa-99c8-2be31f2db1dc None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:04.025031 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3445096-af76-4d28-b0f4-d6df2e191b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:04.025754 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3445096-af76-4d28-b0f4-d6df2e191b68 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:04.026036 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3445096-af76-4d28-b0f4-d6df2e191b68 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:04.026312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3445096-af76-4d28-b0f4-d6df2e191b68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:04.037233 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3445096-af76-4d28-b0f4-d6df2e191b68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:04.045916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-d3445096-af76-4d28-b0f4-d6df2e191b68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:53:04.045916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:04.045916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:04.045916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:04.045916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:04.045916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:04.045916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:04.045916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:04.045916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:04.045916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:04.045916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:04.045916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:04.045916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:04.045916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:04.045916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:04.045916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:04.046852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:04.046852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:04.046852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:04.046852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:04.046852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:04.046852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:04.046852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:04.046852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:04.046852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:04.046852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:04.046852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:04.046852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:04.046852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:04.046852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:04.046852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:04.046852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:04.048291 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:04.048291 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:04.048291 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:04.048291 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:04.048291 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:04.048291 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:04.048291 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:04.048291 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:04.048291 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:04.048291 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:04.048291 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:53:04.048291 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:04.048291 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 176/343] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:53:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:04.048951 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedc3fb-5028-465e-85ca-18328a5d33e8 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:04.048951 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedc3fb-5028-465e-85ca-18328a5d33e8 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:04.048951 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedc3fb-5028-465e-85ca-18328a5d33e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:04.063527 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f526136-c0b4-42d0-8117-774e4195a362 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:04.072745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-6aedc3fb-5028-465e-85ca-18328a5d33e8 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:04.073995 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-6aedc3fb-5028-465e-85ca-18328a5d33e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:04.103935 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134a5f1-e80f-4a84-8e02-2bb282acb044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:04.104717 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134a5f1-e80f-4a84-8e02-2bb282acb044 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:04.105145 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134a5f1-e80f-4a84-8e02-2bb282acb044 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:04.105423 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134a5f1-e80f-4a84-8e02-2bb282acb044 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:04.106501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134a5f1-e80f-4a84-8e02-2bb282acb044 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:04.107075 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134a5f1-e80f-4a84-8e02-2bb282acb044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:04.108601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134a5f1-e80f-4a84-8e02-2bb282acb044 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:04.119719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 168/344] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:04.125039 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134a5f1-e80f-4a84-8e02-2bb282acb044 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:04.153118 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 177/345] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:04.154037 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedc3fb-5028-465e-85ca-18328a5d33e8 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:04.229941 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134a5f1-e80f-4a84-8e02-2bb282acb044 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:04.263474 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd54fd4-82c1-4e93-aeba-1b591379d5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:04.264301 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd54fd4-82c1-4e93-aeba-1b591379d5b3 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:04.264579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd54fd4-82c1-4e93-aeba-1b591379d5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:04.264852 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd54fd4-82c1-4e93-aeba-1b591379d5b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:04.275964 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd54fd4-82c1-4e93-aeba-1b591379d5b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:04.283562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-8cd54fd4-82c1-4e93-aeba-1b591379d5b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:53:04.283562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:04.283562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:04.283562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:04.283562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:04.283562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:04.283562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:04.283562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:04.283562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:04.283562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:04.283562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:04.283562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:04.283562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:04.283562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:04.283562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:04.283562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:04.285780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:04.285780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:04.285780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:04.285780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:04.285780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:04.285780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:04.285780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:04.285780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:04.285780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:04.285780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:04.285780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:04.285780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:04.285780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:04.285780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:04.285780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:04.285780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:04.288024 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:04.288024 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:04.288024 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:04.288024 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:04.288024 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:04.288024 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:04.288024 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:04.288024 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:04.288024 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:04.288024 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:04.288024 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:53:04.288024 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:04.288024 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 169/346] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:53:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:04.288024 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd54fd4-82c1-4e93-aeba-1b591379d5b3 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:04.291973 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedc3fb-5028-465e-85ca-18328a5d33e8 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:04.328537 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cd919-929b-43d4-9174-2a98ae3bedd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:04.329278 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cd919-929b-43d4-9174-2a98ae3bedd9 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:04.329566 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cd919-929b-43d4-9174-2a98ae3bedd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:04.329844 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cd919-929b-43d4-9174-2a98ae3bedd9 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:04.330593 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9cd919-929b-43d4-9174-2a98ae3bedd9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:04.330899 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9cd919-929b-43d4-9174-2a98ae3bedd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:04.332326 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9cd919-929b-43d4-9174-2a98ae3bedd9 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:04.341064 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 178/347] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:53:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:04.341673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cd919-929b-43d4-9174-2a98ae3bedd9 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:04.398017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd54fd4-82c1-4e93-aeba-1b591379d5b3 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:04.443559 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868068f-9d2b-4947-8779-6288fc66efcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:04.444664 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868068f-9d2b-4947-8779-6288fc66efcb None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:04.445179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868068f-9d2b-4947-8779-6288fc66efcb None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:04.445659 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868068f-9d2b-4947-8779-6288fc66efcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:04.463037 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cd919-929b-43d4-9174-2a98ae3bedd9 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:04.503798 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881d226-5b6f-4a4e-b769-7ce6a8ee2822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:04.504440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881d226-5b6f-4a4e-b769-7ce6a8ee2822 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:04.504440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881d226-5b6f-4a4e-b769-7ce6a8ee2822 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:04.504744 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881d226-5b6f-4a4e-b769-7ce6a8ee2822 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:04.517713 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881d226-5b6f-4a4e-b769-7ce6a8ee2822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:04.523463 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868068f-9d2b-4947-8779-6288fc66efcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:04.525117 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868068f-9d2b-4947-8779-6288fc66efcb None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:04.525578 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-a881d226-5b6f-4a4e-b769-7ce6a8ee2822 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:53:04.525578 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:04.525578 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:04.525578 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:04.525578 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:04.525578 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:04.525578 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:04.525578 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:04.525578 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:04.525578 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:04.525578 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:04.525578 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:04.525578 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:04.525578 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:04.525578 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:04.525578 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:04.526470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:04.526470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:04.526470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:04.526470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:04.526470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:04.526470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:04.526470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:04.526470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:04.526470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:04.526470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:04.526470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:04.526470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:04.526470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:04.526470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:04.526470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:04.526470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:04.527271 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:04.527271 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:04.527271 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:04.527271 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:04.527271 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:04.527271 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:04.527271 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:04.527271 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:04.527271 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:04.527271 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:04.527271 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 16:53:04.527271 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:04.527271 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 179/348] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:53:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:04.528847 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881d226-5b6f-4a4e-b769-7ce6a8ee2822 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:04.658256 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 170/349] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:53:04.658456 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881d226-5b6f-4a4e-b769-7ce6a8ee2822 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:04.659467 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191e77e-62ff-4125-8ee6-a650bb577070 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:04.659809 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191e77e-62ff-4125-8ee6-a650bb577070 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:04.660047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191e77e-62ff-4125-8ee6-a650bb577070 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:04.661485 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 171/350] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:04.662130 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191e77e-62ff-4125-8ee6-a650bb577070 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:04.700237 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa5bbe-11ae-4476-a75a-c80cf625bd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:04.700905 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa5bbe-11ae-4476-a75a-c80cf625bd33 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:04.701184 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa5bbe-11ae-4476-a75a-c80cf625bd33 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:04.701451 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa5bbe-11ae-4476-a75a-c80cf625bd33 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:04.702198 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa5bbe-11ae-4476-a75a-c80cf625bd33 None admin] RBAC: Adding query filter params (name=member) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:04.702498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa5bbe-11ae-4476-a75a-c80cf625bd33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:04.704000 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa5bbe-11ae-4476-a75a-c80cf625bd33 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:04.712637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 180/351] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:53:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:04.713488 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa5bbe-11ae-4476-a75a-c80cf625bd33 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:04.795689 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191e77e-62ff-4125-8ee6-a650bb577070 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:04.827944 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa5bbe-11ae-4476-a75a-c80cf625bd33 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:04.842498 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f120d1e-0bf0-4044-b2d2-81d649e662bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:04.843686 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f120d1e-0bf0-4044-b2d2-81d649e662bc None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:04.844014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f120d1e-0bf0-4044-b2d2-81d649e662bc None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:04.844384 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f120d1e-0bf0-4044-b2d2-81d649e662bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:04.866189 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ae1c5-bc64-4ed2-a867-db8e20247e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:04.866854 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ae1c5-bc64-4ed2-a867-db8e20247e7b None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:04.867136 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ae1c5-bc64-4ed2-a867-db8e20247e7b None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:04.867412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ae1c5-bc64-4ed2-a867-db8e20247e7b None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:04.868185 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ae1c5-bc64-4ed2-a867-db8e20247e7b None admin] RBAC: Adding query filter params (name=reader) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:04.868489 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ae1c5-bc64-4ed2-a867-db8e20247e7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:04.869892 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ae1c5-bc64-4ed2-a867-db8e20247e7b None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:04.878615 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 181/352] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:53:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:04.879896 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ae1c5-bc64-4ed2-a867-db8e20247e7b None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:04.940803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f120d1e-0bf0-4044-b2d2-81d649e662bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:04.943258 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f120d1e-0bf0-4044-b2d2-81d649e662bc None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:05.018517 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ae1c5-bc64-4ed2-a867-db8e20247e7b None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:05.062669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2cce0-7100-4449-98ab-b91284f703fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:05.063449 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2cce0-7100-4449-98ab-b91284f703fb None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:05.063906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 172/353] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:53:05.064024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2cce0-7100-4449-98ab-b91284f703fb None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:05.064024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2cce0-7100-4449-98ab-b91284f703fb None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:05.065345 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e3b59-5c26-450e-bcdd-718e41a66568 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:05.065345 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e3b59-5c26-450e-bcdd-718e41a66568 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:05.065514 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2cce0-7100-4449-98ab-b91284f703fb None admin] RBAC: Authorizing `identity:get_project(project_id=f86e7cbe28eb448b87b50a4d37dce199)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:05.065779 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e3b59-5c26-450e-bcdd-718e41a66568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:05.066954 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2cce0-7100-4449-98ab-b91284f703fb None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:05.068874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 182/354] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:53:04 2022] GET /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:05.069517 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2cce0-7100-4449-98ab-b91284f703fb None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:05.087109 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-cc3e3b59-5c26-450e-bcdd-718e41a66568 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:05.088353 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-cc3e3b59-5c26-450e-bcdd-718e41a66568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:05.163455 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 173/355] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:05.164309 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e3b59-5c26-450e-bcdd-718e41a66568 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:05.187070 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2cce0-7100-4449-98ab-b91284f703fb None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:05.224349 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a91a17-f9e6-43e2-9b62-bb60b1a4bc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:05.224349 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a91a17-f9e6-43e2-9b62-bb60b1a4bc23 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:05.224349 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a91a17-f9e6-43e2-9b62-bb60b1a4bc23 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:05.224683 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a91a17-f9e6-43e2-9b62-bb60b1a4bc23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:05.276306 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e3b59-5c26-450e-bcdd-718e41a66568 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:05.299426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a91a17-f9e6-43e2-9b62-bb60b1a4bc23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:05.301042 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a91a17-f9e6-43e2-9b62-bb60b1a4bc23 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:05.315581 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4a6f4-7932-49c7-8c4a-8c5175ce6c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:05.316424 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4a6f4-7932-49c7-8c4a-8c5175ce6c28 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:05.316703 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4a6f4-7932-49c7-8c4a-8c5175ce6c28 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:05.316977 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4a6f4-7932-49c7-8c4a-8c5175ce6c28 None admin] PATH_INFO: `/v3/users/2604f655e47e4c93a1ba79dd3901bed9` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:05.318173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4a6f4-7932-49c7-8c4a-8c5175ce6c28 None admin] RBAC: Authorizing `identity:get_user(user_id=2604f655e47e4c93a1ba79dd3901bed9)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:05.319627 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4a6f4-7932-49c7-8c4a-8c5175ce6c28 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:05.321662 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 174/356] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 12 16:53:05 2022] GET /identity/v3/users/2604f655e47e4c93a1ba79dd3901bed9 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:05.322576 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4a6f4-7932-49c7-8c4a-8c5175ce6c28 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:05.415809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 183/357] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:53:05.417004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a91a17-f9e6-43e2-9b62-bb60b1a4bc23 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:05.442058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4a6f4-7932-49c7-8c4a-8c5175ce6c28 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:05.478834 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca366b2-45d2-4f55-9ba0-754326f4f7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:05.479734 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca366b2-45d2-4f55-9ba0-754326f4f7f5 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:05.480021 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca366b2-45d2-4f55-9ba0-754326f4f7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:05.480296 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca366b2-45d2-4f55-9ba0-754326f4f7f5 None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:05.481490 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca366b2-45d2-4f55-9ba0-754326f4f7f5 None admin] RBAC: Authorizing `identity:get_project(project_id=f86e7cbe28eb448b87b50a4d37dce199)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:05.482931 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca366b2-45d2-4f55-9ba0-754326f4f7f5 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:05.484740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 175/358] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:53:05 2022] GET /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:05.485984 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e72b78-7caf-4f7f-b167-c65fa34e7b42 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:05.486265 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e72b78-7caf-4f7f-b167-c65fa34e7b42 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:05.486542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e72b78-7caf-4f7f-b167-c65fa34e7b42 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:05.489140 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 176/359] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:05.489920 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e72b78-7caf-4f7f-b167-c65fa34e7b42 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:05.525679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a91a17-f9e6-43e2-9b62-bb60b1a4bc23 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:05.560181 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b28b8-2b51-4894-b24d-5ac705f21cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:05.561053 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b28b8-2b51-4894-b24d-5ac705f21cf6 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:05.561327 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b28b8-2b51-4894-b24d-5ac705f21cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:05.561599 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b28b8-2b51-4894-b24d-5ac705f21cf6 None admin] PATH_INFO: `/v3/groups/73937900025c470b9e05888ec3705d5e` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:05.568277 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b28b8-2b51-4894-b24d-5ac705f21cf6 None admin] RBAC: Authorizing `identity:get_group(group_id=73937900025c470b9e05888ec3705d5e)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:05.569675 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82b28b8-2b51-4894-b24d-5ac705f21cf6 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:05.571512 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 184/360] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 12 16:53:05 2022] GET /identity/v3/groups/73937900025c470b9e05888ec3705d5e => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:05.572161 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b28b8-2b51-4894-b24d-5ac705f21cf6 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:05.600811 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e72b78-7caf-4f7f-b167-c65fa34e7b42 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:05.635941 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaec91-afa0-4e72-b123-39496322a6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:05.636812 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaec91-afa0-4e72-b123-39496322a6a2 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:05.637093 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaec91-afa0-4e72-b123-39496322a6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:05.637393 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaec91-afa0-4e72-b123-39496322a6a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:05.649814 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaec91-afa0-4e72-b123-39496322a6a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:05.657955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-43aaec91-afa0-4e72-b123-39496322a6a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:53:05.657955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:05.657955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:05.657955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:05.657955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:05.657955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:05.657955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:05.657955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:05.657955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:05.657955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:05.657955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:05.657955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:05.657955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:05.657955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:05.657955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:05.657955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:05.658866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:05.658866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:05.658866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:05.658866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:05.658866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:05.658866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:05.658866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:05.658866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:05.658866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:05.658866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:05.658866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:05.658866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:05.658866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:05.658866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:05.658866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:05.658866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:05.660193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:05.660193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:05.660193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:05.660193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:05.660193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:05.660193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:05.660193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:05.660193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:05.660193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:05.660193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:05.660193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:53:05.660193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:05.660193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 177/361] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:53:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:05.660865 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaec91-afa0-4e72-b123-39496322a6a2 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:05.672492 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b28b8-2b51-4894-b24d-5ac705f21cf6 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:05.707460 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16a905-0a34-4faa-9a5e-0ad074b5fac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:05.708406 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16a905-0a34-4faa-9a5e-0ad074b5fac4 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:05.708685 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16a905-0a34-4faa-9a5e-0ad074b5fac4 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:05.709091 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16a905-0a34-4faa-9a5e-0ad074b5fac4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:05.709776 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16a905-0a34-4faa-9a5e-0ad074b5fac4 None admin] RBAC: Adding query filter params (role.id=2088f05fbc394bb4a8b98c44c2af1309, user.id=2604f655e47e4c93a1ba79dd3901bed9, scope.system=all) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:05.710162 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16a905-0a34-4faa-9a5e-0ad074b5fac4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:05.711515 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16a905-0a34-4faa-9a5e-0ad074b5fac4 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:05.732075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 185/362] 10.222.0.64 () {56 vars in 1308 bytes} [Thu May 12 16:53:05 2022] GET /identity/v3/role_assignments?user.id=2604f655e47e4c93a1ba79dd3901bed9&scope.system=all&role.id=2088f05fbc394bb4a8b98c44c2af1309 => generated 510 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:05.733595 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12f18e-47a6-4a0b-a51c-0ec3e68bca81 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:05.733930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12f18e-47a6-4a0b-a51c-0ec3e68bca81 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:05.734207 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12f18e-47a6-4a0b-a51c-0ec3e68bca81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:05.755694 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-6d12f18e-47a6-4a0b-a51c-0ec3e68bca81 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:05.757636 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-6d12f18e-47a6-4a0b-a51c-0ec3e68bca81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:05.780890 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaec91-afa0-4e72-b123-39496322a6a2 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:05.823871 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534f087-e6d6-4d35-ad22-af744b0e13c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:05.824731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534f087-e6d6-4d35-ad22-af744b0e13c7 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:05.825040 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534f087-e6d6-4d35-ad22-af744b0e13c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:05.825421 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534f087-e6d6-4d35-ad22-af744b0e13c7 None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:05.828600 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534f087-e6d6-4d35-ad22-af744b0e13c7 None admin] RBAC: Authorizing `identity:get_project(project_id=7de1a1d5d5f041ddbc5231b5975a3a68)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:05.830064 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534f087-e6d6-4d35-ad22-af744b0e13c7 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:05.831984 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 178/363] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:53:05 2022] GET /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:05.832874 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534f087-e6d6-4d35-ad22-af744b0e13c7 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:05.841593 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 186/364] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:05.842882 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12f18e-47a6-4a0b-a51c-0ec3e68bca81 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:05.979947 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534f087-e6d6-4d35-ad22-af744b0e13c7 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:05.986079 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12f18e-47a6-4a0b-a51c-0ec3e68bca81 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:06.024532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a32cd-832a-4347-ac06-9196850bc83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:06.025193 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a32cd-832a-4347-ac06-9196850bc83e None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:06.025468 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a32cd-832a-4347-ac06-9196850bc83e None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:06.025648 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fcdfa-6b24-4b47-a57f-56a51ee70ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:06.025775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a32cd-832a-4347-ac06-9196850bc83e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:06.026511 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fcdfa-6b24-4b47-a57f-56a51ee70ff0 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:06.026616 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a32cd-832a-4347-ac06-9196850bc83e None admin] RBAC: Adding query filter params (group.id=73937900025c470b9e05888ec3705d5e, role.id=f45adb34d54d49558694df72aec6b99d, scope.project.id=f86e7cbe28eb448b87b50a4d37dce199) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:06.026797 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fcdfa-6b24-4b47-a57f-56a51ee70ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:06.026895 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a32cd-832a-4347-ac06-9196850bc83e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:06.027077 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fcdfa-6b24-4b47-a57f-56a51ee70ff0 None admin] PATH_INFO: `/v3/groups/73937900025c470b9e05888ec3705d5e` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:06.028291 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fcdfa-6b24-4b47-a57f-56a51ee70ff0 None admin] RBAC: Authorizing `identity:get_group(group_id=73937900025c470b9e05888ec3705d5e)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:06.028782 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a32cd-832a-4347-ac06-9196850bc83e None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:06.030558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fcdfa-6b24-4b47-a57f-56a51ee70ff0 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:06.036092 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 179/365] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 12 16:53:05 2022] GET /identity/v3/groups/73937900025c470b9e05888ec3705d5e => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:06.036092 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fcdfa-6b24-4b47-a57f-56a51ee70ff0 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:06.036323 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 187/366] 10.222.0.64 () {56 vars in 1376 bytes} [Thu May 12 16:53:05 2022] GET /identity/v3/role_assignments?group.id=73937900025c470b9e05888ec3705d5e&scope.project.id=f86e7cbe28eb448b87b50a4d37dce199&role.id=f45adb34d54d49558694df72aec6b99d => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:06.036323 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a32cd-832a-4347-ac06-9196850bc83e None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:06.170970 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fcdfa-6b24-4b47-a57f-56a51ee70ff0 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:06.173665 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a32cd-832a-4347-ac06-9196850bc83e None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:06.213789 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecdd70-d2c7-41a9-8ee0-c99287d89367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:06.214963 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecdd70-d2c7-41a9-8ee0-c99287d89367 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:06.215461 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecdd70-d2c7-41a9-8ee0-c99287d89367 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:06.215998 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecdd70-d2c7-41a9-8ee0-c99287d89367 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:06.217416 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecdd70-d2c7-41a9-8ee0-c99287d89367 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:06.217951 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecdd70-d2c7-41a9-8ee0-c99287d89367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:06.221031 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecdd70-d2c7-41a9-8ee0-c99287d89367 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:06.222643 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e99866-3faa-4295-8717-d1c97bc75f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:06.223758 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e99866-3faa-4295-8717-d1c97bc75f1c None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:06.224765 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e99866-3faa-4295-8717-d1c97bc75f1c None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:06.225262 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e99866-3faa-4295-8717-d1c97bc75f1c None admin] PATH_INFO: `/v3/groups/73937900025c470b9e05888ec3705d5e` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:06.229865 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e99866-3faa-4295-8717-d1c97bc75f1c None admin] RBAC: Authorizing `identity:get_group(group_id=73937900025c470b9e05888ec3705d5e)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:06.231149 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 180/367] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:06.231477 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e99866-3faa-4295-8717-d1c97bc75f1c None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:06.232704 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecdd70-d2c7-41a9-8ee0-c99287d89367 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:06.235289 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 188/368] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 12 16:53:06 2022] GET /identity/v3/groups/73937900025c470b9e05888ec3705d5e => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:06.236159 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e99866-3faa-4295-8717-d1c97bc75f1c None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:06.345874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e99866-3faa-4295-8717-d1c97bc75f1c None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:06.357464 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecdd70-d2c7-41a9-8ee0-c99287d89367 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:06.387281 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b88fd-afb4-494c-8379-3114975e7f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:06.387972 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b88fd-afb4-494c-8379-3114975e7f00 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:06.388254 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b88fd-afb4-494c-8379-3114975e7f00 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:06.388526 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b88fd-afb4-494c-8379-3114975e7f00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:06.389359 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b88fd-afb4-494c-8379-3114975e7f00 None admin] RBAC: Adding query filter params (group.id=73937900025c470b9e05888ec3705d5e, role.id=0474b158b4bc4046ac169d53fff04721, scope.project.id=f86e7cbe28eb448b87b50a4d37dce199) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:06.389677 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b88fd-afb4-494c-8379-3114975e7f00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:06.391172 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b88fd-afb4-494c-8379-3114975e7f00 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:06.394546 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ff261-ced3-4ddc-a0c0-ba18733b8f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:06.395587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ff261-ced3-4ddc-a0c0-ba18733b8f02 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:06.396082 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ff261-ced3-4ddc-a0c0-ba18733b8f02 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:06.396553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ff261-ced3-4ddc-a0c0-ba18733b8f02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:06.396672 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 189/369] 10.222.0.64 () {56 vars in 1376 bytes} [Thu May 12 16:53:06 2022] GET /identity/v3/role_assignments?group.id=73937900025c470b9e05888ec3705d5e&scope.project.id=f86e7cbe28eb448b87b50a4d37dce199&role.id=0474b158b4bc4046ac169d53fff04721 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:06.397475 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b88fd-afb4-494c-8379-3114975e7f00 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:06.417504 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ff261-ced3-4ddc-a0c0-ba18733b8f02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:06.426323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-cd7ff261-ced3-4ddc-a0c0-ba18733b8f02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:53:06.426323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:06.426323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:06.426323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:06.426323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:06.426323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:06.426323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:06.426323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:06.426323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:06.426323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:06.426323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:06.426323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:06.426323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:06.426323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:06.426323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:06.426323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:06.427332 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:06.427332 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:06.427332 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:06.427332 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:06.427332 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:06.427332 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:06.427332 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:06.427332 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:06.427332 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:06.427332 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:06.427332 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:06.427332 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:06.427332 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:06.427332 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:06.427332 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:06.427332 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:06.428170 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:06.428170 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:06.428170 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:06.428170 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:06.428170 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:06.428170 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:06.428170 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:06.428170 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:06.428170 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:06.428170 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:06.428170 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:53:06.428170 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:06.432050 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 181/370] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 12 16:53:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:06.433035 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ff261-ced3-4ddc-a0c0-ba18733b8f02 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:06.522431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b88fd-afb4-494c-8379-3114975e7f00 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:06.550116 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ff261-ced3-4ddc-a0c0-ba18733b8f02 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:06.572312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be8ea8-c7a0-4815-a48d-882c2d73b15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:06.573434 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be8ea8-c7a0-4815-a48d-882c2d73b15b None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:06.573434 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be8ea8-c7a0-4815-a48d-882c2d73b15b None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:06.573620 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be8ea8-c7a0-4815-a48d-882c2d73b15b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:06.588892 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690937ac-ddcb-46bd-b7f0-dccf617566d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:06.590103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690937ac-ddcb-46bd-b7f0-dccf617566d4 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:06.590569 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690937ac-ddcb-46bd-b7f0-dccf617566d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:06.591027 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690937ac-ddcb-46bd-b7f0-dccf617566d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:06.592093 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690937ac-ddcb-46bd-b7f0-dccf617566d4 None admin] RBAC: Adding query filter params (group.id=73937900025c470b9e05888ec3705d5e, role.id=0474b158b4bc4046ac169d53fff04721, scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:06.592609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690937ac-ddcb-46bd-b7f0-dccf617566d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:06.594813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690937ac-ddcb-46bd-b7f0-dccf617566d4 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:06.601731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 182/371] 10.222.0.64 () {56 vars in 1376 bytes} [Thu May 12 16:53:06 2022] GET /identity/v3/role_assignments?group.id=73937900025c470b9e05888ec3705d5e&scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68&role.id=0474b158b4bc4046ac169d53fff04721 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:06.603214 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690937ac-ddcb-46bd-b7f0-dccf617566d4 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:06.650150 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be8ea8-c7a0-4815-a48d-882c2d73b15b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:06.651687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be8ea8-c7a0-4815-a48d-882c2d73b15b None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:06.714109 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690937ac-ddcb-46bd-b7f0-dccf617566d4 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:06.754863 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 190/372] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:53:06.759722 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162a367-1b24-459d-b535-bc906a1e63db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:06.760309 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be8ea8-c7a0-4815-a48d-882c2d73b15b None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:06.760444 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162a367-1b24-459d-b535-bc906a1e63db None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:06.760677 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162a367-1b24-459d-b535-bc906a1e63db None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:06.760954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162a367-1b24-459d-b535-bc906a1e63db None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:06.761718 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162a367-1b24-459d-b535-bc906a1e63db None admin] RBAC: Adding query filter params (name=admin) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:06.762025 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162a367-1b24-459d-b535-bc906a1e63db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:06.763411 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162a367-1b24-459d-b535-bc906a1e63db None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:06.780107 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 183/373] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:53:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:06.788407 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162a367-1b24-459d-b535-bc906a1e63db None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:06.881728 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be8ea8-c7a0-4815-a48d-882c2d73b15b None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:06.951688 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162a367-1b24-459d-b535-bc906a1e63db None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:06.970475 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711a11f-6842-4fa1-af50-5b6efccf1aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:06.971647 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711a11f-6842-4fa1-af50-5b6efccf1aa7 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:06.972071 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711a11f-6842-4fa1-af50-5b6efccf1aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:06.972485 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711a11f-6842-4fa1-af50-5b6efccf1aa7 None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:06.976682 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711a11f-6842-4fa1-af50-5b6efccf1aa7 None admin] RBAC: Authorizing `identity:get_project(project_id=7de1a1d5d5f041ddbc5231b5975a3a68)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:06.978403 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711a11f-6842-4fa1-af50-5b6efccf1aa7 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:06.983313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 191/374] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:53:06 2022] GET /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:06.987629 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711a11f-6842-4fa1-af50-5b6efccf1aa7 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:06.993889 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf96361-2610-4222-97a3-93b38574327b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:06.994678 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf96361-2610-4222-97a3-93b38574327b None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:06.995079 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf96361-2610-4222-97a3-93b38574327b None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:06.995471 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf96361-2610-4222-97a3-93b38574327b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:07.113524 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf96361-2610-4222-97a3-93b38574327b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:07.115218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf96361-2610-4222-97a3-93b38574327b None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:07.169776 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711a11f-6842-4fa1-af50-5b6efccf1aa7 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:07.230892 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed4ae0-8f52-4940-a3f3-7a56768bc6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:07.232022 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed4ae0-8f52-4940-a3f3-7a56768bc6c4 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:07.233623 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed4ae0-8f52-4940-a3f3-7a56768bc6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:07.236015 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed4ae0-8f52-4940-a3f3-7a56768bc6c4 None admin] PATH_INFO: `/v3/groups/73937900025c470b9e05888ec3705d5e` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:07.239005 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed4ae0-8f52-4940-a3f3-7a56768bc6c4 None admin] RBAC: Authorizing `identity:get_group(group_id=73937900025c470b9e05888ec3705d5e)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:07.240800 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed4ae0-8f52-4940-a3f3-7a56768bc6c4 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:07.243947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 192/375] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 12 16:53:06 2022] GET /identity/v3/groups/73937900025c470b9e05888ec3705d5e => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:07.254640 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed4ae0-8f52-4940-a3f3-7a56768bc6c4 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:07.313894 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 184/376] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 16:53:07.322855 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf96361-2610-4222-97a3-93b38574327b None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:07.408701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed4ae0-8f52-4940-a3f3-7a56768bc6c4 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:07.449809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef6350-a0f5-4326-a154-6974d777d2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:07.450467 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef6350-a0f5-4326-a154-6974d777d2e3 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:07.450749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef6350-a0f5-4326-a154-6974d777d2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:07.451024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef6350-a0f5-4326-a154-6974d777d2e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:07.453880 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef6350-a0f5-4326-a154-6974d777d2e3 None admin] RBAC: Adding query filter params (group.id=73937900025c470b9e05888ec3705d5e, role.id=f45adb34d54d49558694df72aec6b99d, scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:07.454202 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef6350-a0f5-4326-a154-6974d777d2e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:07.455673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef6350-a0f5-4326-a154-6974d777d2e3 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:07.472357 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 193/377] 10.222.0.64 () {56 vars in 1376 bytes} [Thu May 12 16:53:07 2022] GET /identity/v3/role_assignments?group.id=73937900025c470b9e05888ec3705d5e&scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68&role.id=f45adb34d54d49558694df72aec6b99d => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:07.512673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf96361-2610-4222-97a3-93b38574327b None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:07.571007 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114a604-6c32-4438-b16c-cf4e8c083abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:07.571930 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114a604-6c32-4438-b16c-cf4e8c083abf None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:07.572216 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114a604-6c32-4438-b16c-cf4e8c083abf None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:07.572494 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114a604-6c32-4438-b16c-cf4e8c083abf None admin] PATH_INFO: `/v3/projects/3dca91e00e894d69a0b385cea4a3db66` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:07.573836 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114a604-6c32-4438-b16c-cf4e8c083abf None admin] RBAC: Authorizing `identity:get_project(project_id=3dca91e00e894d69a0b385cea4a3db66)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:07.575339 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114a604-6c32-4438-b16c-cf4e8c083abf None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:07.577178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 185/378] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:53:07 2022] GET /identity/v3/projects/3dca91e00e894d69a0b385cea4a3db66 => generated 344 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:07.583344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef6350-a0f5-4326-a154-6974d777d2e3 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:07.746018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef6350-a0f5-4326-a154-6974d777d2e3 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:07.779294 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892e9a5-b903-470c-93e9-2d9f850e8840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:07.780104 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892e9a5-b903-470c-93e9-2d9f850e8840 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:07.780381 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892e9a5-b903-470c-93e9-2d9f850e8840 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:07.781177 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892e9a5-b903-470c-93e9-2d9f850e8840 None admin] PATH_INFO: `/v3/groups/4f3791de28374405adcdc70585faa0c6` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:07.786538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892e9a5-b903-470c-93e9-2d9f850e8840 None admin] RBAC: Authorizing `identity:get_group(group_id=4f3791de28374405adcdc70585faa0c6)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:07.788143 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d892e9a5-b903-470c-93e9-2d9f850e8840 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:07.789771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 194/379] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 12 16:53:07 2022] GET /identity/v3/groups/4f3791de28374405adcdc70585faa0c6 => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:07.795500 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114a604-6c32-4438-b16c-cf4e8c083abf None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:07.928382 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114a604-6c32-4438-b16c-cf4e8c083abf None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:07.969534 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c9f7e-4cd7-4958-a831-4b573a342be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:07.970247 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c9f7e-4cd7-4958-a831-4b573a342be9 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:07.970587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c9f7e-4cd7-4958-a831-4b573a342be9 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:07.970807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c9f7e-4cd7-4958-a831-4b573a342be9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:07.971711 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c9f7e-4cd7-4958-a831-4b573a342be9 None admin] RBAC: Adding query filter params (group.id=4f3791de28374405adcdc70585faa0c6, role.id=fbd6364b42a641f695c0b265a789057a, scope.project.id=3dca91e00e894d69a0b385cea4a3db66) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:07.972026 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c9f7e-4cd7-4958-a831-4b573a342be9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:07.973473 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c9f7e-4cd7-4958-a831-4b573a342be9 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:07.979849 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 186/380] 10.222.0.64 () {56 vars in 1376 bytes} [Thu May 12 16:53:07 2022] GET /identity/v3/role_assignments?group.id=4f3791de28374405adcdc70585faa0c6&scope.project.id=3dca91e00e894d69a0b385cea4a3db66&role.id=fbd6364b42a641f695c0b265a789057a => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:08.637946 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47873c-a3a8-42ef-8f82-f3c85746f68a None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:08.638469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47873c-a3a8-42ef-8f82-f3c85746f68a None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:08.638586 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47873c-a3a8-42ef-8f82-f3c85746f68a None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:08.640775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 195/381] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:08.648503 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e570ffa-0a69-4541-832c-c40fcf6db9d4 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:08.648503 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e570ffa-0a69-4541-832c-c40fcf6db9d4 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:08.648503 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e570ffa-0a69-4541-832c-c40fcf6db9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:08.664434 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-9e570ffa-0a69-4541-832c-c40fcf6db9d4 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:08.665628 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-9e570ffa-0a69-4541-832c-c40fcf6db9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:08.744004 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 187/382] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:08.768203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47873c-a3a8-42ef-8f82-f3c85746f68a None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:08.876839 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47873c-a3a8-42ef-8f82-f3c85746f68a None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:08.913315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0157f-5e93-4ed9-b9e7-6870209e102a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:08.913315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0157f-5e93-4ed9-b9e7-6870209e102a None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:08.913315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0157f-5e93-4ed9-b9e7-6870209e102a None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:08.913315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0157f-5e93-4ed9-b9e7-6870209e102a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:08.924430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0157f-5e93-4ed9-b9e7-6870209e102a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:08.932813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-5ff0157f-5e93-4ed9-b9e7-6870209e102a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:53:08.932813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:08.932813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:08.932813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:08.932813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:08.932813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:08.932813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:08.932813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:08.932813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:08.932813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:08.932813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:08.932813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:08.932813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:08.932813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:08.932813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:08.932813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:08.933661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:08.933661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:08.933661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:08.933661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:08.933661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:08.933661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:08.933661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:08.933661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:08.933661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:08.933661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:08.933661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:08.933661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:08.933661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:08.933661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:08.933661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:08.933661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:08.934440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:08.934440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:08.934440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:08.934440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:08.934440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:08.934440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:08.934440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:08.934440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:08.934440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:08.934440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:08.934440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:53:08.934440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:08.934440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 196/383] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:53:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:08.940622 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e570ffa-0a69-4541-832c-c40fcf6db9d4 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:09.056376 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e570ffa-0a69-4541-832c-c40fcf6db9d4 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:09.068979 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd51a50-3d56-45b9-b30f-965475f3ed06 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:09.069271 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd51a50-3d56-45b9-b30f-965475f3ed06 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:09.069542 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd51a50-3d56-45b9-b30f-965475f3ed06 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:09.074444 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 197/384] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:09.075878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e7be4-3ffc-4086-93d2-a5af121c5169 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:09.076170 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e7be4-3ffc-4086-93d2-a5af121c5169 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:09.076451 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e7be4-3ffc-4086-93d2-a5af121c5169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:09.095809 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1e323-5b54-41a6-aaf7-331c86ac0549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:09.096481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1e323-5b54-41a6-aaf7-331c86ac0549 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:09.096757 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1e323-5b54-41a6-aaf7-331c86ac0549 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:09.097027 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1e323-5b54-41a6-aaf7-331c86ac0549 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:09.097774 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1e323-5b54-41a6-aaf7-331c86ac0549 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:09.098077 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1e323-5b54-41a6-aaf7-331c86ac0549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:09.099441 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1e323-5b54-41a6-aaf7-331c86ac0549 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:09.111548 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-350e7be4-3ffc-4086-93d2-a5af121c5169 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:09.112751 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-350e7be4-3ffc-4086-93d2-a5af121c5169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:09.116737 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 188/385] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:09.122595 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1e323-5b54-41a6-aaf7-331c86ac0549 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:09.223909 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1e323-5b54-41a6-aaf7-331c86ac0549 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:09.257191 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690356a-1d61-4010-8cee-66f3b9d46aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:09.258047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690356a-1d61-4010-8cee-66f3b9d46aa6 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:09.258322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690356a-1d61-4010-8cee-66f3b9d46aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:09.258591 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690356a-1d61-4010-8cee-66f3b9d46aa6 None admin] PATH_INFO: `/v3/groups/73937900025c470b9e05888ec3705d5e` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:09.259802 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690356a-1d61-4010-8cee-66f3b9d46aa6 None admin] RBAC: Authorizing `identity:get_group(group_id=73937900025c470b9e05888ec3705d5e)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:09.261243 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690356a-1d61-4010-8cee-66f3b9d46aa6 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:09.263151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 189/386] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 12 16:53:09 2022] GET /identity/v3/groups/73937900025c470b9e05888ec3705d5e => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:09.268660 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690356a-1d61-4010-8cee-66f3b9d46aa6 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:09.271130 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 198/387] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:09.325357 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e7be4-3ffc-4086-93d2-a5af121c5169 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:09.404136 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690356a-1d61-4010-8cee-66f3b9d46aa6 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:09.438885 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2f7ce-f854-4ad7-899f-954848b75444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:09.439796 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2f7ce-f854-4ad7-899f-954848b75444 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:09.440173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2f7ce-f854-4ad7-899f-954848b75444 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:09.440476 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2f7ce-f854-4ad7-899f-954848b75444 None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:09.441705 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2f7ce-f854-4ad7-899f-954848b75444 None admin] RBAC: Authorizing `identity:get_project(project_id=f86e7cbe28eb448b87b50a4d37dce199)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:09.443174 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2f7ce-f854-4ad7-899f-954848b75444 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:09.445238 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 190/388] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:53:09 2022] GET /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:09.450879 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2f7ce-f854-4ad7-899f-954848b75444 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:09.524517 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e7be4-3ffc-4086-93d2-a5af121c5169 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:09.568813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2f7ce-f854-4ad7-899f-954848b75444 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:09.603798 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf42ed0-e7d8-4ff5-bed0-d34ddb43b490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:09.604693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf42ed0-e7d8-4ff5-bed0-d34ddb43b490 None admin] REQUEST_METHOD: `PUT` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:09.604971 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf42ed0-e7d8-4ff5-bed0-d34ddb43b490 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:09.605243 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf42ed0-e7d8-4ff5-bed0-d34ddb43b490 None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199/groups/73937900025c470b9e05888ec3705d5e/roles/f45adb34d54d49558694df72aec6b99d` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:09.605675 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779c734-1817-417e-9884-7ddb47706e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:09.606666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779c734-1817-417e-9884-7ddb47706e3a None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:09.607042 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779c734-1817-417e-9884-7ddb47706e3a None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:09.607323 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779c734-1817-417e-9884-7ddb47706e3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:09.607435 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf42ed0-e7d8-4ff5-bed0-d34ddb43b490 None admin] RBAC: Authorizing `identity:create_grant(project_id=f86e7cbe28eb448b87b50a4d37dce199, group_id=73937900025c470b9e05888ec3705d5e, role_id=f45adb34d54d49558694df72aec6b99d)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:09.609580 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf42ed0-e7d8-4ff5-bed0-d34ddb43b490 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:09.620132 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779c734-1817-417e-9884-7ddb47706e3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:09.628422 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 191/389] 10.222.0.64 () {58 vars in 1442 bytes} [Thu May 12 16:53:09 2022] PUT /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199/groups/73937900025c470b9e05888ec3705d5e/roles/f45adb34d54d49558694df72aec6b99d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:53:09.629841 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cf4e6-62e5-4388-98be-ff9261484860 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:09.630132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cf4e6-62e5-4388-98be-ff9261484860 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:09.630408 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cf4e6-62e5-4388-98be-ff9261484860 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:09.632873 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-f779c734-1817-417e-9884-7ddb47706e3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:53:09.632873 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:09.632873 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:09.632873 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:09.632873 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:09.632873 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:09.632873 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:09.632873 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:09.632873 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:09.632873 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:09.632873 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:09.632873 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:09.632873 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:09.632873 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:09.632873 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:09.632873 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:09.633731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:09.633731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:09.633731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:09.633731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:09.633731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:09.633731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:09.633731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:09.633731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:09.633731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:09.633731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:09.633731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:09.633731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:09.633731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:09.633731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:09.633731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:09.633731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:09.634539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:09.634539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:09.634539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:09.634539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:09.634539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:09.634539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:09.634539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:09.634539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:09.634539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:09.634539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:09.634539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:53:09.634539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:09.634539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 199/390] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:53:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:09.637781 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 192/391] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:09.643688 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779c734-1817-417e-9884-7ddb47706e3a None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:09.647397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe75a5-5e15-443d-bc8c-158cb8d1a5bf None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:09.648768 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe75a5-5e15-443d-bc8c-158cb8d1a5bf None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:09.648768 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe75a5-5e15-443d-bc8c-158cb8d1a5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:09.690124 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-1bbe75a5-5e15-443d-bc8c-158cb8d1a5bf None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:09.695691 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-1bbe75a5-5e15-443d-bc8c-158cb8d1a5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:09.806799 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 193/392] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:09.832081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe75a5-5e15-443d-bc8c-158cb8d1a5bf None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:09.845423 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779c734-1817-417e-9884-7ddb47706e3a None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:09.881213 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88296ad8-0143-4280-993e-8eda2ad1a8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:09.882275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88296ad8-0143-4280-993e-8eda2ad1a8e3 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:09.882833 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88296ad8-0143-4280-993e-8eda2ad1a8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:09.883330 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88296ad8-0143-4280-993e-8eda2ad1a8e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:09.884371 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88296ad8-0143-4280-993e-8eda2ad1a8e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:09.884894 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88296ad8-0143-4280-993e-8eda2ad1a8e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:09.886480 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88296ad8-0143-4280-993e-8eda2ad1a8e3 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:09.898102 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 200/393] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:53:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:09.903410 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88296ad8-0143-4280-993e-8eda2ad1a8e3 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:10.016792 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88296ad8-0143-4280-993e-8eda2ad1a8e3 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:10.022391 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe75a5-5e15-443d-bc8c-158cb8d1a5bf None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:10.055887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516c7f2-3d80-4a31-b062-b55828815bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:10.057193 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516c7f2-3d80-4a31-b062-b55828815bdf None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:10.057692 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516c7f2-3d80-4a31-b062-b55828815bdf None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:10.058170 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516c7f2-3d80-4a31-b062-b55828815bdf None admin] PATH_INFO: `/v3/groups/73937900025c470b9e05888ec3705d5e` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:10.059645 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516c7f2-3d80-4a31-b062-b55828815bdf None admin] RBAC: Authorizing `identity:get_group(group_id=73937900025c470b9e05888ec3705d5e)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:10.062217 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516c7f2-3d80-4a31-b062-b55828815bdf None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:10.065003 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 201/394] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 12 16:53:09 2022] GET /identity/v3/groups/73937900025c470b9e05888ec3705d5e => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:10.076506 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516c7f2-3d80-4a31-b062-b55828815bdf None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:10.098338 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bdc24-122c-4f30-8b07-55899c4623ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:10.099149 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bdc24-122c-4f30-8b07-55899c4623ca None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:10.099431 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bdc24-122c-4f30-8b07-55899c4623ca None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:10.099731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bdc24-122c-4f30-8b07-55899c4623ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:10.120862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038bdc24-122c-4f30-8b07-55899c4623ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:10.139707 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-038bdc24-122c-4f30-8b07-55899c4623ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:53:10.139707 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:10.139707 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:10.139707 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:10.139707 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:10.139707 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:10.139707 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:10.139707 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:10.139707 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:10.139707 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:10.139707 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:10.139707 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:10.139707 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:10.139707 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:10.139707 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:10.139707 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:10.141246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:10.141246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:10.141246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:10.141246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:10.141246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:10.141246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:10.141246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:10.141246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:10.141246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:10.141246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:10.141246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:10.141246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:10.141246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:10.141246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:10.141246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:10.141246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:10.142029 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:10.142029 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:10.142029 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:10.142029 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:10.142029 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:10.142029 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:10.142029 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:10.142029 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:10.142029 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:10.142029 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:10.142029 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:53:10.142029 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:10.142029 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 194/395] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:53:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:53:10.160429 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bdc24-122c-4f30-8b07-55899c4623ca None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:10.193586 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516c7f2-3d80-4a31-b062-b55828815bdf None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:10.230339 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c50a8-7cd1-4c0b-9a70-8b77ef206788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:10.231579 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c50a8-7cd1-4c0b-9a70-8b77ef206788 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:10.232175 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c50a8-7cd1-4c0b-9a70-8b77ef206788 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:10.232682 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c50a8-7cd1-4c0b-9a70-8b77ef206788 None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:10.234192 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c50a8-7cd1-4c0b-9a70-8b77ef206788 None admin] RBAC: Authorizing `identity:get_project(project_id=f86e7cbe28eb448b87b50a4d37dce199)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:10.235945 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c50a8-7cd1-4c0b-9a70-8b77ef206788 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:10.238200 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 202/396] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:53:10 2022] GET /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:10.253599 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c50a8-7cd1-4c0b-9a70-8b77ef206788 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:10.303494 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bdc24-122c-4f30-8b07-55899c4623ca None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:10.349342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bbdd0-5969-4451-a7fe-977a67fd3337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:10.349946 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bbdd0-5969-4451-a7fe-977a67fd3337 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:10.350227 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bbdd0-5969-4451-a7fe-977a67fd3337 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:10.350577 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bbdd0-5969-4451-a7fe-977a67fd3337 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:10.351500 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2bbdd0-5969-4451-a7fe-977a67fd3337 None admin] RBAC: Adding query filter params (name=member) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:10.351830 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2bbdd0-5969-4451-a7fe-977a67fd3337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:10.353215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2bbdd0-5969-4451-a7fe-977a67fd3337 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:10.368636 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c50a8-7cd1-4c0b-9a70-8b77ef206788 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:10.376770 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 195/397] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:53:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:10.377791 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bbdd0-5969-4451-a7fe-977a67fd3337 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:10.422012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29125c0-97eb-472f-811c-09308da8cbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:10.423867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29125c0-97eb-472f-811c-09308da8cbc0 None admin] REQUEST_METHOD: `PUT` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:10.424357 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29125c0-97eb-472f-811c-09308da8cbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:10.424894 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29125c0-97eb-472f-811c-09308da8cbc0 None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199/groups/73937900025c470b9e05888ec3705d5e/roles/0474b158b4bc4046ac169d53fff04721` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:10.427138 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29125c0-97eb-472f-811c-09308da8cbc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f86e7cbe28eb448b87b50a4d37dce199, group_id=73937900025c470b9e05888ec3705d5e, role_id=0474b158b4bc4046ac169d53fff04721)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:10.428819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29125c0-97eb-472f-811c-09308da8cbc0 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:10.475315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 203/398] 10.222.0.64 () {58 vars in 1442 bytes} [Thu May 12 16:53:10 2022] PUT /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199/groups/73937900025c470b9e05888ec3705d5e/roles/0474b158b4bc4046ac169d53fff04721 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 16:53:10.496683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bbdd0-5969-4451-a7fe-977a67fd3337 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:10.539622 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c9099-331f-48fa-bb98-84d83e21d1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:10.540549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c9099-331f-48fa-bb98-84d83e21d1c4 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:10.540834 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c9099-331f-48fa-bb98-84d83e21d1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:10.541113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c9099-331f-48fa-bb98-84d83e21d1c4 None admin] PATH_INFO: `/v3/groups/73937900025c470b9e05888ec3705d5e` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:10.548720 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c9099-331f-48fa-bb98-84d83e21d1c4 None admin] RBAC: Authorizing `identity:get_group(group_id=73937900025c470b9e05888ec3705d5e)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:10.550245 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c9099-331f-48fa-bb98-84d83e21d1c4 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:10.552440 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 196/399] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 12 16:53:10 2022] GET /identity/v3/groups/73937900025c470b9e05888ec3705d5e => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:10.558245 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29125c0-97eb-472f-811c-09308da8cbc0 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:10.713640 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29125c0-97eb-472f-811c-09308da8cbc0 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:10.747069 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4483d17-ce98-4d59-9423-d020c92b97f9 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:10.747448 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4483d17-ce98-4d59-9423-d020c92b97f9 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:10.747618 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4483d17-ce98-4d59-9423-d020c92b97f9 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:10.749340 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 197/400] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:53:10.749951 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5c584-1e66-4bc0-8398-b05bc776bf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:10.750833 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5c584-1e66-4bc0-8398-b05bc776bf4f None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:10.751138 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5c584-1e66-4bc0-8398-b05bc776bf4f None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:10.751414 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5c584-1e66-4bc0-8398-b05bc776bf4f None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:10.755506 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5c584-1e66-4bc0-8398-b05bc776bf4f None admin] RBAC: Authorizing `identity:get_project(project_id=7de1a1d5d5f041ddbc5231b5975a3a68)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:10.755506 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5c584-1e66-4bc0-8398-b05bc776bf4f None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:10.756994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 204/401] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:53:10 2022] GET /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:10.757365 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627d590-a0d2-4e25-b634-3f030ae3284f None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:10.757845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627d590-a0d2-4e25-b634-3f030ae3284f None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:10.758310 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627d590-a0d2-4e25-b634-3f030ae3284f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:10.762297 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5c584-1e66-4bc0-8398-b05bc776bf4f None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:10.776935 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-5627d590-a0d2-4e25-b634-3f030ae3284f None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:10.778174 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-5627d590-a0d2-4e25-b634-3f030ae3284f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:10.851538 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 198/402] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:10.853010 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14fd52-7939-44a6-8147-6eb293da9572 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:10.853298 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14fd52-7939-44a6-8147-6eb293da9572 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:10.853579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14fd52-7939-44a6-8147-6eb293da9572 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:10.856806 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 199/403] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:10.861565 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da84134-8a5d-41e8-b3ab-a704ab16c04d None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:10.861857 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da84134-8a5d-41e8-b3ab-a704ab16c04d None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:10.862134 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da84134-8a5d-41e8-b3ab-a704ab16c04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:10.887161 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5c584-1e66-4bc0-8398-b05bc776bf4f None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:10.887773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-0da84134-8a5d-41e8-b3ab-a704ab16c04d None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:10.889026 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-0da84134-8a5d-41e8-b3ab-a704ab16c04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:10.928439 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e73cde-5bff-4363-8228-d58d7da69f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:10.929339 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e73cde-5bff-4363-8228-d58d7da69f36 None admin] REQUEST_METHOD: `PUT` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:10.929732 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e73cde-5bff-4363-8228-d58d7da69f36 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:10.930012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e73cde-5bff-4363-8228-d58d7da69f36 None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68/groups/73937900025c470b9e05888ec3705d5e/roles/0474b158b4bc4046ac169d53fff04721` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:10.933034 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e73cde-5bff-4363-8228-d58d7da69f36 None admin] RBAC: Authorizing `identity:create_grant(project_id=7de1a1d5d5f041ddbc5231b5975a3a68, group_id=73937900025c470b9e05888ec3705d5e, role_id=0474b158b4bc4046ac169d53fff04721)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:10.934512 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e73cde-5bff-4363-8228-d58d7da69f36 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:10.951533 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 205/404] 10.222.0.64 () {58 vars in 1442 bytes} [Thu May 12 16:53:10 2022] PUT /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68/groups/73937900025c470b9e05888ec3705d5e/roles/0474b158b4bc4046ac169d53fff04721 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 16:53:10.957799 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e73cde-5bff-4363-8228-d58d7da69f36 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:10.986744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 200/405] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:11.038543 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da84134-8a5d-41e8-b3ab-a704ab16c04d None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:11.131483 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e73cde-5bff-4363-8228-d58d7da69f36 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:11.153307 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da84134-8a5d-41e8-b3ab-a704ab16c04d None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:11.191368 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79154b51-b526-47b4-816b-00a4ab86655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:11.192233 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79154b51-b526-47b4-816b-00a4ab86655f None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:11.192516 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79154b51-b526-47b4-816b-00a4ab86655f None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:11.192852 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79154b51-b526-47b4-816b-00a4ab86655f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:11.216798 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79154b51-b526-47b4-816b-00a4ab86655f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:11.219009 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1b27f-582e-49c2-a7c1-fa2b92e65ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:11.219892 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1b27f-582e-49c2-a7c1-fa2b92e65ba0 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:11.220199 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1b27f-582e-49c2-a7c1-fa2b92e65ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:11.220441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1b27f-582e-49c2-a7c1-fa2b92e65ba0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:11.235182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-79154b51-b526-47b4-816b-00a4ab86655f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:53:11.235182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:11.235182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:11.235182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:11.235182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:11.235182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:11.235182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:11.235182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:11.235182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:11.235182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:11.235182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:11.235182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:11.235182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:11.235182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:11.235182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:11.235182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:11.236151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:11.236151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:11.236151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:11.236151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:11.236151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:11.236151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:11.236151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:11.236151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:11.236151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:11.236151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:11.236151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:11.236151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:11.236151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:11.236151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:11.236151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:11.236151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:11.237070 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:11.237070 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:11.237070 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:11.237070 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:11.237070 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:11.237070 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:11.237070 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:11.237070 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:11.237070 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:11.237070 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:11.237070 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:53:11.237070 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:11.237687 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 201/406] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:53:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:53:11.244536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79154b51-b526-47b4-816b-00a4ab86655f None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:11.249354 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1b27f-582e-49c2-a7c1-fa2b92e65ba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:11.265860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-1ff1b27f-582e-49c2-a7c1-fa2b92e65ba0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:53:11.265860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:11.265860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:11.265860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:11.265860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:11.265860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:11.265860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:11.265860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:11.265860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:11.265860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:11.265860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:11.265860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:11.265860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:11.265860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:11.265860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:11.265860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:11.266756 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:11.266756 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:11.266756 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:11.266756 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:11.266756 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:11.266756 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:11.266756 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:11.266756 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:11.266756 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:11.266756 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:11.266756 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:11.266756 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:11.266756 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:11.266756 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:11.266756 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:11.266756 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:11.267556 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:11.267556 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:11.267556 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:11.267556 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:11.267556 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:11.267556 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:11.267556 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:11.267556 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:11.267556 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:11.267556 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:11.267556 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:53:11.267556 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:11.267556 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 206/407] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 12 16:53:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:11.275958 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1b27f-582e-49c2-a7c1-fa2b92e65ba0 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:11.359161 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79154b51-b526-47b4-816b-00a4ab86655f None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:11.424036 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1524f-1e11-4d7b-ab39-b381b10d1eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:11.425058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1524f-1e11-4d7b-ab39-b381b10d1eb5 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:11.425542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1524f-1e11-4d7b-ab39-b381b10d1eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:11.426014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1524f-1e11-4d7b-ab39-b381b10d1eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:11.426962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1524f-1e11-4d7b-ab39-b381b10d1eb5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:11.427502 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1524f-1e11-4d7b-ab39-b381b10d1eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:11.429151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1524f-1e11-4d7b-ab39-b381b10d1eb5 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:11.444199 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1b27f-582e-49c2-a7c1-fa2b92e65ba0 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:11.446109 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 202/408] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:11.457296 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1524f-1e11-4d7b-ab39-b381b10d1eb5 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:11.484483 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a502102-9cae-4cab-a7ee-100b5ca9bbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:11.485459 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a502102-9cae-4cab-a7ee-100b5ca9bbbc None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:11.485946 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a502102-9cae-4cab-a7ee-100b5ca9bbbc None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:11.486442 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a502102-9cae-4cab-a7ee-100b5ca9bbbc None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:11.487441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a502102-9cae-4cab-a7ee-100b5ca9bbbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:11.487995 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a502102-9cae-4cab-a7ee-100b5ca9bbbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:11.489593 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a502102-9cae-4cab-a7ee-100b5ca9bbbc None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:11.498226 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 207/409] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:53:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:11.504423 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a502102-9cae-4cab-a7ee-100b5ca9bbbc None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:11.627219 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a502102-9cae-4cab-a7ee-100b5ca9bbbc None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:11.638266 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1524f-1e11-4d7b-ab39-b381b10d1eb5 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:11.661786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810540a9-bb40-42bd-88fe-b4e5235b3316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:11.663028 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810540a9-bb40-42bd-88fe-b4e5235b3316 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:11.663768 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810540a9-bb40-42bd-88fe-b4e5235b3316 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:11.664558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810540a9-bb40-42bd-88fe-b4e5235b3316 None admin] PATH_INFO: `/v3/groups/4f3791de28374405adcdc70585faa0c6` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:11.666106 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810540a9-bb40-42bd-88fe-b4e5235b3316 None admin] RBAC: Authorizing `identity:get_group(group_id=4f3791de28374405adcdc70585faa0c6)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:11.668701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810540a9-bb40-42bd-88fe-b4e5235b3316 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:11.672164 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 208/410] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 12 16:53:11 2022] GET /identity/v3/groups/4f3791de28374405adcdc70585faa0c6 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:11.684998 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810540a9-bb40-42bd-88fe-b4e5235b3316 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:11.711343 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9bb91-1027-4fcc-9008-5436a4b262ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:11.712316 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9bb91-1027-4fcc-9008-5436a4b262ad None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:11.712602 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9bb91-1027-4fcc-9008-5436a4b262ad None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:11.712845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9bb91-1027-4fcc-9008-5436a4b262ad None admin] PATH_INFO: `/v3/groups/73937900025c470b9e05888ec3705d5e` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:11.716855 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9bb91-1027-4fcc-9008-5436a4b262ad None admin] RBAC: Authorizing `identity:get_group(group_id=73937900025c470b9e05888ec3705d5e)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:11.719074 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9bb91-1027-4fcc-9008-5436a4b262ad None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:11.727237 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 203/411] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 12 16:53:11 2022] GET /identity/v3/groups/73937900025c470b9e05888ec3705d5e => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:11.729135 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9bb91-1027-4fcc-9008-5436a4b262ad None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:11.819408 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810540a9-bb40-42bd-88fe-b4e5235b3316 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:11.857740 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e3bde-f061-4067-81a8-104d1b7e3b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:11.859580 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e3bde-f061-4067-81a8-104d1b7e3b1c None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:11.860258 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e3bde-f061-4067-81a8-104d1b7e3b1c None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:11.860737 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e3bde-f061-4067-81a8-104d1b7e3b1c None admin] PATH_INFO: `/v3/projects/3dca91e00e894d69a0b385cea4a3db66` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:11.862332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e3bde-f061-4067-81a8-104d1b7e3b1c None admin] RBAC: Authorizing `identity:get_project(project_id=3dca91e00e894d69a0b385cea4a3db66)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:11.864019 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e3bde-f061-4067-81a8-104d1b7e3b1c None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:11.866871 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 209/412] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:53:11 2022] GET /identity/v3/projects/3dca91e00e894d69a0b385cea4a3db66 => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:11.873333 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e3bde-f061-4067-81a8-104d1b7e3b1c None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:11.912342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9bb91-1027-4fcc-9008-5436a4b262ad None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:11.962012 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd11a97-f4d4-45f0-b7c5-0179fed0788d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:11.962609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd11a97-f4d4-45f0-b7c5-0179fed0788d None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:11.962894 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd11a97-f4d4-45f0-b7c5-0179fed0788d None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:11.963167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd11a97-f4d4-45f0-b7c5-0179fed0788d None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:11.968922 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd11a97-f4d4-45f0-b7c5-0179fed0788d None admin] RBAC: Authorizing `identity:get_project(project_id=7de1a1d5d5f041ddbc5231b5975a3a68)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:11.970566 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd11a97-f4d4-45f0-b7c5-0179fed0788d None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:11.972541 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 204/413] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:53:11 2022] GET /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:11.980809 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd11a97-f4d4-45f0-b7c5-0179fed0788d None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:12.000017 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e3bde-f061-4067-81a8-104d1b7e3b1c None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:12.048651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c73f5a-8706-441a-9bcf-a1f37d2047c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:12.049915 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c73f5a-8706-441a-9bcf-a1f37d2047c9 None admin] REQUEST_METHOD: `PUT` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:12.050449 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c73f5a-8706-441a-9bcf-a1f37d2047c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:12.050927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c73f5a-8706-441a-9bcf-a1f37d2047c9 None admin] PATH_INFO: `/v3/projects/3dca91e00e894d69a0b385cea4a3db66/groups/4f3791de28374405adcdc70585faa0c6/roles/fbd6364b42a641f695c0b265a789057a` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:12.053150 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c73f5a-8706-441a-9bcf-a1f37d2047c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3dca91e00e894d69a0b385cea4a3db66, group_id=4f3791de28374405adcdc70585faa0c6, role_id=fbd6364b42a641f695c0b265a789057a)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:12.054813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c73f5a-8706-441a-9bcf-a1f37d2047c9 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:12.079107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 210/414] 10.222.0.64 () {58 vars in 1442 bytes} [Thu May 12 16:53:11 2022] PUT /identity/v3/projects/3dca91e00e894d69a0b385cea4a3db66/groups/4f3791de28374405adcdc70585faa0c6/roles/fbd6364b42a641f695c0b265a789057a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 16:53:12.140237 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd11a97-f4d4-45f0-b7c5-0179fed0788d None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:12.192436 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4b6eb-5c49-4a11-85df-15d5c22e8e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:12.193724 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4b6eb-5c49-4a11-85df-15d5c22e8e6e None admin] REQUEST_METHOD: `PUT` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:12.194269 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4b6eb-5c49-4a11-85df-15d5c22e8e6e None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:12.194746 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4b6eb-5c49-4a11-85df-15d5c22e8e6e None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68/groups/73937900025c470b9e05888ec3705d5e/roles/f45adb34d54d49558694df72aec6b99d` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:12.197348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4b6eb-5c49-4a11-85df-15d5c22e8e6e None admin] RBAC: Authorizing `identity:create_grant(project_id=7de1a1d5d5f041ddbc5231b5975a3a68, group_id=73937900025c470b9e05888ec3705d5e, role_id=f45adb34d54d49558694df72aec6b99d)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:12.199071 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb4b6eb-5c49-4a11-85df-15d5c22e8e6e None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:12.237821 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 205/415] 10.222.0.64 () {58 vars in 1442 bytes} [Thu May 12 16:53:11 2022] PUT /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68/groups/73937900025c470b9e05888ec3705d5e/roles/f45adb34d54d49558694df72aec6b99d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 16:53:12.512996 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781414a2-fbfa-4eb8-bd33-8f0326455e4d None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:12.513369 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781414a2-fbfa-4eb8-bd33-8f0326455e4d None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:12.513571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781414a2-fbfa-4eb8-bd33-8f0326455e4d None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:12.515246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 211/416] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:12.520914 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be5eed-4e54-4037-af8f-3d0fefc54cf1 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:12.521209 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be5eed-4e54-4037-af8f-3d0fefc54cf1 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:12.521488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be5eed-4e54-4037-af8f-3d0fefc54cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:12.539993 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-79be5eed-4e54-4037-af8f-3d0fefc54cf1 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:12.541179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-79be5eed-4e54-4037-af8f-3d0fefc54cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:12.630058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 206/417] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:12.671155 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781414a2-fbfa-4eb8-bd33-8f0326455e4d None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:12.804375 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781414a2-fbfa-4eb8-bd33-8f0326455e4d None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:12.849717 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd6975-f793-41cd-8f36-787256653e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:12.850531 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd6975-f793-41cd-8f36-787256653e24 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:12.850809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd6975-f793-41cd-8f36-787256653e24 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:12.851074 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd6975-f793-41cd-8f36-787256653e24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:12.865629 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd6975-f793-41cd-8f36-787256653e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:12.873615 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-ffcd6975-f793-41cd-8f36-787256653e24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:53:12.873615 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:12.873615 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:12.873615 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:12.873615 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:12.873615 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:12.873615 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:12.873615 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:12.873615 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:12.873615 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:12.873615 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:12.873615 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:12.873615 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:12.873615 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:12.873615 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:12.873615 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:12.874521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:12.874521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:12.874521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:12.874521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:12.874521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:12.874521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:12.874521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:12.874521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:12.874521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:12.874521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:12.874521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:12.874521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:12.874521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:12.874521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:12.874521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:12.874521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:12.875315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:12.875315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:12.875315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:12.875315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:12.875315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:12.875315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:12.875315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:12.875315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:12.875315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:12.875315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:12.875315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:53:12.875315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:12.875315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 212/418] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:53:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:12.880796 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be5eed-4e54-4037-af8f-3d0fefc54cf1 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:12.989224 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709fe81-788b-4afe-8470-3d5051f5e206 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:12.989531 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709fe81-788b-4afe-8470-3d5051f5e206 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:12.989782 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709fe81-788b-4afe-8470-3d5051f5e206 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:12.991406 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 213/419] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:13.000852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339a0ed-0f4b-4228-b2d3-3cfdae2f970b None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:13.001133 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339a0ed-0f4b-4228-b2d3-3cfdae2f970b None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:13.001409 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339a0ed-0f4b-4228-b2d3-3cfdae2f970b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:13.012819 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be5eed-4e54-4037-af8f-3d0fefc54cf1 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:13.040634 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-2339a0ed-0f4b-4228-b2d3-3cfdae2f970b None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:13.041873 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-2339a0ed-0f4b-4228-b2d3-3cfdae2f970b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:13.049770 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5b4de-0a45-4227-8947-4fc84b58c68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:13.050441 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5b4de-0a45-4227-8947-4fc84b58c68d None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:13.050720 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5b4de-0a45-4227-8947-4fc84b58c68d None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:13.050994 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5b4de-0a45-4227-8947-4fc84b58c68d None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:13.051767 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5b4de-0a45-4227-8947-4fc84b58c68d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:13.052076 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5b4de-0a45-4227-8947-4fc84b58c68d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:13.053452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5b4de-0a45-4227-8947-4fc84b58c68d None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:13.062482 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 207/420] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:13.067770 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5b4de-0a45-4227-8947-4fc84b58c68d None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:13.156218 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 214/421] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:13.201075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339a0ed-0f4b-4228-b2d3-3cfdae2f970b None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:13.224356 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5b4de-0a45-4227-8947-4fc84b58c68d None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:13.279867 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815a3fb-c2af-4682-be6f-12441f419f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:13.280904 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815a3fb-c2af-4682-be6f-12441f419f21 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:13.281393 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815a3fb-c2af-4682-be6f-12441f419f21 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:13.281894 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815a3fb-c2af-4682-be6f-12441f419f21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:13.366437 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339a0ed-0f4b-4228-b2d3-3cfdae2f970b None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:13.407992 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83dcd8b-b1fd-4510-9dcb-2b06cf2b1cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:13.409158 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dcd8b-b1fd-4510-9dcb-2b06cf2b1cb1 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:13.409642 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dcd8b-b1fd-4510-9dcb-2b06cf2b1cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:13.410150 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dcd8b-b1fd-4510-9dcb-2b06cf2b1cb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:13.432290 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83dcd8b-b1fd-4510-9dcb-2b06cf2b1cb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:13.442441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-a83dcd8b-b1fd-4510-9dcb-2b06cf2b1cb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:53:13.442441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:13.442441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:13.442441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:13.442441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:13.442441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:13.442441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:13.442441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:13.442441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:13.442441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:13.442441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:13.442441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:13.442441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:13.442441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:13.442441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:13.442441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:13.443322 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:13.443322 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:13.443322 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:13.443322 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:13.443322 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:13.443322 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:13.443322 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:13.443322 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:13.443322 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:13.443322 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:13.443322 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:13.443322 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:13.443322 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:13.443322 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:13.443322 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:13.443322 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:13.444228 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:13.444228 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:13.444228 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:13.444228 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:13.444228 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:13.444228 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:13.444228 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:13.444228 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:13.444228 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:13.444228 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:13.444228 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:53:13.444228 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:13.444825 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815a3fb-c2af-4682-be6f-12441f419f21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:13.445889 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815a3fb-c2af-4682-be6f-12441f419f21 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:13.447168 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 215/422] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:53:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:13.452659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83dcd8b-b1fd-4510-9dcb-2b06cf2b1cb1 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:13.545111 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 208/423] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 16:53:13.553308 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815a3fb-c2af-4682-be6f-12441f419f21 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:13.585529 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83dcd8b-b1fd-4510-9dcb-2b06cf2b1cb1 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:13.631264 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1e4e0-f078-411d-a7a9-098f3286b553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:13.632321 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1e4e0-f078-411d-a7a9-098f3286b553 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:13.632818 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1e4e0-f078-411d-a7a9-098f3286b553 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:13.633295 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1e4e0-f078-411d-a7a9-098f3286b553 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:13.634270 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1e4e0-f078-411d-a7a9-098f3286b553 None admin] RBAC: Adding query filter params (name=member) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:13.634780 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1e4e0-f078-411d-a7a9-098f3286b553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:13.636412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1e4e0-f078-411d-a7a9-098f3286b553 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:13.645630 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 216/424] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:53:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:13.652628 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1e4e0-f078-411d-a7a9-098f3286b553 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:13.663802 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815a3fb-c2af-4682-be6f-12441f419f21 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:13.712494 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5c26f-da7c-4723-bc3c-921e2441ba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:13.713259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5c26f-da7c-4723-bc3c-921e2441ba40 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:13.713544 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5c26f-da7c-4723-bc3c-921e2441ba40 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:13.713828 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5c26f-da7c-4723-bc3c-921e2441ba40 None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:13.715070 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5c26f-da7c-4723-bc3c-921e2441ba40 None admin] RBAC: Authorizing `identity:get_project(project_id=f86e7cbe28eb448b87b50a4d37dce199)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:13.716565 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5c26f-da7c-4723-bc3c-921e2441ba40 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:13.719109 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 209/425] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:53:13 2022] GET /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:13.728594 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5c26f-da7c-4723-bc3c-921e2441ba40 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:13.778270 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1e4e0-f078-411d-a7a9-098f3286b553 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:13.822150 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b1d76-684b-4301-9296-f36e3e7c7ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:13.823244 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b1d76-684b-4301-9296-f36e3e7c7ac3 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:13.823800 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b1d76-684b-4301-9296-f36e3e7c7ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:13.828951 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b1d76-684b-4301-9296-f36e3e7c7ac3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:13.901839 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b1d76-684b-4301-9296-f36e3e7c7ac3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:13.904013 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b1d76-684b-4301-9296-f36e3e7c7ac3 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:14.004130 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 217/426] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:53:14.010575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b1d76-684b-4301-9296-f36e3e7c7ac3 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:14.014002 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5c26f-da7c-4723-bc3c-921e2441ba40 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:14.051895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edddf0-e768-430f-a70e-dbbe9c128763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:14.053078 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edddf0-e768-430f-a70e-dbbe9c128763 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:14.053533 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edddf0-e768-430f-a70e-dbbe9c128763 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:14.053979 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edddf0-e768-430f-a70e-dbbe9c128763 None admin] PATH_INFO: `/v3/groups/73937900025c470b9e05888ec3705d5e` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:14.055324 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edddf0-e768-430f-a70e-dbbe9c128763 None admin] RBAC: Authorizing `identity:get_group(group_id=73937900025c470b9e05888ec3705d5e)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:14.057001 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edddf0-e768-430f-a70e-dbbe9c128763 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:14.059068 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 210/427] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 12 16:53:13 2022] GET /identity/v3/groups/73937900025c470b9e05888ec3705d5e => generated 226 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:14.064632 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862bd9a-fef8-46f6-82dc-da4c3d16e22f None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:14.065124 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862bd9a-fef8-46f6-82dc-da4c3d16e22f None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:14.065618 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862bd9a-fef8-46f6-82dc-da4c3d16e22f None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:14.067093 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 211/428] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:14.068765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862bd9a-fef8-46f6-82dc-da4c3d16e22f None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:14.123079 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b1d76-684b-4301-9296-f36e3e7c7ac3 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:14.156876 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fa18b-f691-4029-b0d6-4702606eed56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:14.157701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fa18b-f691-4029-b0d6-4702606eed56 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:14.157983 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fa18b-f691-4029-b0d6-4702606eed56 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:14.158255 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fa18b-f691-4029-b0d6-4702606eed56 None admin] PATH_INFO: `/v3/projects/f86e7cbe28eb448b87b50a4d37dce199` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:14.159435 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fa18b-f691-4029-b0d6-4702606eed56 None admin] RBAC: Authorizing `identity:get_project(project_id=f86e7cbe28eb448b87b50a4d37dce199)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:14.160922 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fa18b-f691-4029-b0d6-4702606eed56 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:14.162947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 218/429] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:53:14 2022] GET /identity/v3/projects/f86e7cbe28eb448b87b50a4d37dce199 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:14.164177 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2964c0-5a48-4743-9399-15e0a61379f2 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:14.164454 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2964c0-5a48-4743-9399-15e0a61379f2 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:14.164723 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2964c0-5a48-4743-9399-15e0a61379f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:14.169251 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862bd9a-fef8-46f6-82dc-da4c3d16e22f None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:14.181389 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-9e2964c0-5a48-4743-9399-15e0a61379f2 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:14.182614 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-9e2964c0-5a48-4743-9399-15e0a61379f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:14.203607 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b0d69-1199-4a24-b0af-32cde43e4690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:14.204296 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b0d69-1199-4a24-b0af-32cde43e4690 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:14.204574 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b0d69-1199-4a24-b0af-32cde43e4690 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:14.204849 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b0d69-1199-4a24-b0af-32cde43e4690 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:14.205666 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b0d69-1199-4a24-b0af-32cde43e4690 None admin] RBAC: Adding query filter params (group.id=73937900025c470b9e05888ec3705d5e, role.id=f45adb34d54d49558694df72aec6b99d, scope.project.id=f86e7cbe28eb448b87b50a4d37dce199) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:14.205972 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b0d69-1199-4a24-b0af-32cde43e4690 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:14.207417 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b0d69-1199-4a24-b0af-32cde43e4690 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:14.213358 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 212/430] 10.222.0.64 () {56 vars in 1376 bytes} [Thu May 12 16:53:14 2022] GET /identity/v3/role_assignments?group.id=73937900025c470b9e05888ec3705d5e&scope.project.id=f86e7cbe28eb448b87b50a4d37dce199&role.id=f45adb34d54d49558694df72aec6b99d => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:14.214231 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b0d69-1199-4a24-b0af-32cde43e4690 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:14.253577 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 219/431] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:14.290194 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2964c0-5a48-4743-9399-15e0a61379f2 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:14.320407 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b0d69-1199-4a24-b0af-32cde43e4690 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:14.355435 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c942189-e074-4091-8d6f-249bffbdfefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:14.356344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c942189-e074-4091-8d6f-249bffbdfefb None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:14.356627 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c942189-e074-4091-8d6f-249bffbdfefb None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:14.356898 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c942189-e074-4091-8d6f-249bffbdfefb None admin] PATH_INFO: `/v3/groups/73937900025c470b9e05888ec3705d5e` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:14.358148 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c942189-e074-4091-8d6f-249bffbdfefb None admin] RBAC: Authorizing `identity:get_group(group_id=73937900025c470b9e05888ec3705d5e)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:14.360164 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c942189-e074-4091-8d6f-249bffbdfefb None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:14.362155 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 213/432] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 12 16:53:14 2022] GET /identity/v3/groups/73937900025c470b9e05888ec3705d5e => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:14.368353 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c942189-e074-4091-8d6f-249bffbdfefb None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:14.491363 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2964c0-5a48-4743-9399-15e0a61379f2 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:14.549473 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c942189-e074-4091-8d6f-249bffbdfefb None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:14.560980 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a2e02-32c0-4447-8354-530f2145dbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:14.561826 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a2e02-32c0-4447-8354-530f2145dbf6 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:14.562109 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a2e02-32c0-4447-8354-530f2145dbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:14.562384 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a2e02-32c0-4447-8354-530f2145dbf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:14.573145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a2e02-32c0-4447-8354-530f2145dbf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:14.584075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-f22a2e02-32c0-4447-8354-530f2145dbf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 16:53:14.584075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:14.584075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:14.584075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:14.584075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:14.584075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:14.584075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:14.584075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:14.584075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:14.584075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:14.584075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:14.584075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:14.584075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:14.584075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:14.584075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:14.584075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:14.584968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:14.584968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:14.584968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:14.584968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:14.584968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:14.584968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:14.584968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:14.584968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:14.584968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:14.584968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:14.584968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:14.584968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:14.584968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:14.584968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:14.584968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:14.584968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:14.585750 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:14.585750 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:14.585750 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:14.585750 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:14.585750 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:14.585750 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:14.585750 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:14.585750 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:14.585750 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:14.585750 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:14.585750 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 16:53:14.585750 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:14.585750 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 220/433] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:53:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:14.590800 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c99ad-b7a2-4808-b1e5-15edd57c455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:14.591475 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a2e02-32c0-4447-8354-530f2145dbf6 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:14.592080 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c99ad-b7a2-4808-b1e5-15edd57c455d None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:14.592572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c99ad-b7a2-4808-b1e5-15edd57c455d None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:14.593572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c99ad-b7a2-4808-b1e5-15edd57c455d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:14.594673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c99ad-b7a2-4808-b1e5-15edd57c455d None admin] RBAC: Adding query filter params (group.id=73937900025c470b9e05888ec3705d5e, role.id=0474b158b4bc4046ac169d53fff04721, scope.project.id=f86e7cbe28eb448b87b50a4d37dce199) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:14.595056 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c99ad-b7a2-4808-b1e5-15edd57c455d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:14.596651 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c99ad-b7a2-4808-b1e5-15edd57c455d None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:14.612275 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 214/434] 10.222.0.64 () {56 vars in 1376 bytes} [Thu May 12 16:53:14 2022] GET /identity/v3/role_assignments?group.id=73937900025c470b9e05888ec3705d5e&scope.project.id=f86e7cbe28eb448b87b50a4d37dce199&role.id=0474b158b4bc4046ac169d53fff04721 => generated 611 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:14.700971 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a2e02-32c0-4447-8354-530f2145dbf6 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:14.737744 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5b905-b721-405f-9ca8-a2980f0a8f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:14.738431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5b905-b721-405f-9ca8-a2980f0a8f9d None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:14.738716 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5b905-b721-405f-9ca8-a2980f0a8f9d None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:14.738992 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5b905-b721-405f-9ca8-a2980f0a8f9d None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:14.739810 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5b905-b721-405f-9ca8-a2980f0a8f9d None admin] RBAC: Adding query filter params (name=member) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:14.740122 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5b905-b721-405f-9ca8-a2980f0a8f9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:14.741641 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5b905-b721-405f-9ca8-a2980f0a8f9d None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:14.752113 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 221/435] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:53:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:14.757798 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c99ad-b7a2-4808-b1e5-15edd57c455d None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:14.884564 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c99ad-b7a2-4808-b1e5-15edd57c455d None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:14.921451 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd3142-5f8d-4a00-961f-bc39befbaebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:14.923290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd3142-5f8d-4a00-961f-bc39befbaebe None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:14.923290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd3142-5f8d-4a00-961f-bc39befbaebe None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:14.923290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd3142-5f8d-4a00-961f-bc39befbaebe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:14.945901 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175bd79-7897-400b-8f01-1a5bb0d56e58 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:14.946382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175bd79-7897-400b-8f01-1a5bb0d56e58 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:14.946457 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175bd79-7897-400b-8f01-1a5bb0d56e58 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:14.948086 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 222/436] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:14.953651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d4888-3ea7-484f-8f4e-b213f70b1e54 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:14.953934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d4888-3ea7-484f-8f4e-b213f70b1e54 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:14.954209 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56d4888-3ea7-484f-8f4e-b213f70b1e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:14.973098 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-a56d4888-3ea7-484f-8f4e-b213f70b1e54 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:14.974285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-a56d4888-3ea7-484f-8f4e-b213f70b1e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:15.001272 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd3142-5f8d-4a00-961f-bc39befbaebe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:15.002174 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd3142-5f8d-4a00-961f-bc39befbaebe None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:15.052671 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 223/437] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:15.054214 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a0e25-b0c5-4b1e-b4f4-ef4a5ef1b79e None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:15.054533 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a0e25-b0c5-4b1e-b4f4-ef4a5ef1b79e None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:15.054776 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a0e25-b0c5-4b1e-b4f4-ef4a5ef1b79e None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:15.056150 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 224/438] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:15.061794 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893c373-3e8c-4195-83f6-6dc71d33f927 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:15.062085 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893c373-3e8c-4195-83f6-6dc71d33f927 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:15.062363 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893c373-3e8c-4195-83f6-6dc71d33f927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:15.080159 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-7893c373-3e8c-4195-83f6-6dc71d33f927 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:15.081345 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-7893c373-3e8c-4195-83f6-6dc71d33f927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:15.110638 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 215/439] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:53:15.111577 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd3142-5f8d-4a00-961f-bc39befbaebe None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:15.152623 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 225/440] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:53:15.153484 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893c373-3e8c-4195-83f6-6dc71d33f927 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:15.223478 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd3142-5f8d-4a00-961f-bc39befbaebe None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:15.265998 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e88c4a-abdb-4e13-b4e7-f40d543b5e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:15.266184 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893c373-3e8c-4195-83f6-6dc71d33f927 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:15.266737 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e88c4a-abdb-4e13-b4e7-f40d543b5e56 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:15.267017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e88c4a-abdb-4e13-b4e7-f40d543b5e56 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:15.267290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e88c4a-abdb-4e13-b4e7-f40d543b5e56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:15.277327 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e88c4a-abdb-4e13-b4e7-f40d543b5e56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:15.285488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-f8e88c4a-abdb-4e13-b4e7-f40d543b5e56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:53:15.285488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:15.285488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:15.285488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:15.285488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:15.285488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:15.285488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:15.285488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:15.285488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:15.285488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:15.285488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:15.285488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:15.285488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:15.285488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:15.285488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:15.285488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:15.286370 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:15.286370 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:15.286370 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:15.286370 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:15.286370 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:15.286370 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:15.286370 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:15.286370 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:15.286370 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:15.286370 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:15.286370 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:15.286370 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:15.286370 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:15.286370 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:15.286370 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:15.286370 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:15.287155 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:15.287155 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:15.287155 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:15.287155 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:15.287155 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:15.287155 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:15.287155 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:15.287155 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:15.287155 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:15.287155 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:15.287155 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 16:53:15.287155 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:15.287155 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 216/441] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:53:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:15.287944 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e88c4a-abdb-4e13-b4e7-f40d543b5e56 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:15.303426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2181f0c-3e4d-4faa-baf1-9b7578bad694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:15.304320 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2181f0c-3e4d-4faa-baf1-9b7578bad694 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:15.304593 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2181f0c-3e4d-4faa-baf1-9b7578bad694 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:15.304867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2181f0c-3e4d-4faa-baf1-9b7578bad694 None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:15.306012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2181f0c-3e4d-4faa-baf1-9b7578bad694 None admin] RBAC: Authorizing `identity:get_project(project_id=7de1a1d5d5f041ddbc5231b5975a3a68)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:15.307455 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2181f0c-3e4d-4faa-baf1-9b7578bad694 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:15.309165 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 226/442] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:53:15 2022] GET /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:15.309911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2181f0c-3e4d-4faa-baf1-9b7578bad694 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:15.381717 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e88c4a-abdb-4e13-b4e7-f40d543b5e56 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:15.405957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2181f0c-3e4d-4faa-baf1-9b7578bad694 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:15.416876 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232f5e9-efc4-4df0-8265-235e5184aa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:15.417668 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232f5e9-efc4-4df0-8265-235e5184aa41 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:15.417950 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232f5e9-efc4-4df0-8265-235e5184aa41 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:15.418221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232f5e9-efc4-4df0-8265-235e5184aa41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:15.428653 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232f5e9-efc4-4df0-8265-235e5184aa41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:15.436322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-3232f5e9-efc4-4df0-8265-235e5184aa41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:53:15.436322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:15.436322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:15.436322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:15.436322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:15.436322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:15.436322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:15.436322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:15.436322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:15.436322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:15.436322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:15.436322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:15.436322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:15.436322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:15.436322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:15.436322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:15.437673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:15.437673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:15.437673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:15.437673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:15.437673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:15.437673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:15.437673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:15.437673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:15.437673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:15.437673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:15.437673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:15.437673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:15.437673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:15.437673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:15.437673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:15.437673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:15.438457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:15.438457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:15.438457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:15.438457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:15.438457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:15.438457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:15.438457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:15.438457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:15.438457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:15.438457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:15.438457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:53:15.438457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:15.438457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 217/443] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 12 16:53:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:15.439087 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232f5e9-efc4-4df0-8265-235e5184aa41 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:15.443207 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa9c24-6652-49c5-a0e8-4734f900138c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:15.444227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa9c24-6652-49c5-a0e8-4734f900138c None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:15.444537 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa9c24-6652-49c5-a0e8-4734f900138c None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:15.444807 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa9c24-6652-49c5-a0e8-4734f900138c None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:15.445550 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa9c24-6652-49c5-a0e8-4734f900138c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:15.445852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa9c24-6652-49c5-a0e8-4734f900138c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:15.447229 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa9c24-6652-49c5-a0e8-4734f900138c None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:15.455939 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 227/444] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:15.456729 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa9c24-6652-49c5-a0e8-4734f900138c None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:15.533276 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232f5e9-efc4-4df0-8265-235e5184aa41 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:15.548232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa9c24-6652-49c5-a0e8-4734f900138c None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:15.566107 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e608931-fc06-46a2-bb87-ce06b2c1b0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:15.566963 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e608931-fc06-46a2-bb87-ce06b2c1b0de None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:15.567240 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e608931-fc06-46a2-bb87-ce06b2c1b0de None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:15.567509 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e608931-fc06-46a2-bb87-ce06b2c1b0de None admin] PATH_INFO: `/v3/groups/73937900025c470b9e05888ec3705d5e` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:15.568722 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e608931-fc06-46a2-bb87-ce06b2c1b0de None admin] RBAC: Authorizing `identity:get_group(group_id=73937900025c470b9e05888ec3705d5e)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:15.570174 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e608931-fc06-46a2-bb87-ce06b2c1b0de None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:15.571809 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 218/445] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 12 16:53:15 2022] GET /identity/v3/groups/73937900025c470b9e05888ec3705d5e => generated 226 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:15.572573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e608931-fc06-46a2-bb87-ce06b2c1b0de None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:15.585202 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c7784-4afc-48cb-a14f-ba3c8a553587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:15.585864 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c7784-4afc-48cb-a14f-ba3c8a553587 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:15.586144 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c7784-4afc-48cb-a14f-ba3c8a553587 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:15.586419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c7784-4afc-48cb-a14f-ba3c8a553587 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:15.587163 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c7784-4afc-48cb-a14f-ba3c8a553587 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:15.587467 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c7784-4afc-48cb-a14f-ba3c8a553587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:15.588865 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c7784-4afc-48cb-a14f-ba3c8a553587 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:15.596764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 228/446] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:53:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:15.597551 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c7784-4afc-48cb-a14f-ba3c8a553587 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:15.665844 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e608931-fc06-46a2-bb87-ce06b2c1b0de None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:15.691688 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c7784-4afc-48cb-a14f-ba3c8a553587 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:15.697814 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d00a80-f30e-4db0-842d-e0734b782830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:15.698458 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d00a80-f30e-4db0-842d-e0734b782830 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:15.698744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d00a80-f30e-4db0-842d-e0734b782830 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:15.699025 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d00a80-f30e-4db0-842d-e0734b782830 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:15.722825 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab58202-ae3b-4355-be19-c9137f665109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:15.723497 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab58202-ae3b-4355-be19-c9137f665109 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:15.723814 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab58202-ae3b-4355-be19-c9137f665109 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:15.724093 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab58202-ae3b-4355-be19-c9137f665109 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:15.724928 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab58202-ae3b-4355-be19-c9137f665109 None admin] RBAC: Adding query filter params (group.id=73937900025c470b9e05888ec3705d5e, role.id=0474b158b4bc4046ac169d53fff04721, scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:15.725248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab58202-ae3b-4355-be19-c9137f665109 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:15.726979 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab58202-ae3b-4355-be19-c9137f665109 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:15.735921 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 229/447] 10.222.0.64 () {56 vars in 1376 bytes} [Thu May 12 16:53:15 2022] GET /identity/v3/role_assignments?group.id=73937900025c470b9e05888ec3705d5e&scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68&role.id=0474b158b4bc4046ac169d53fff04721 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:15.736753 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab58202-ae3b-4355-be19-c9137f665109 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:15.790383 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d00a80-f30e-4db0-842d-e0734b782830 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:15.791821 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d00a80-f30e-4db0-842d-e0734b782830 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:15.845671 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab58202-ae3b-4355-be19-c9137f665109 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:15.886840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dde993-23c3-4e7c-a0d3-d8cf095bbc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:15.887601 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dde993-23c3-4e7c-a0d3-d8cf095bbc48 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:15.887919 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dde993-23c3-4e7c-a0d3-d8cf095bbc48 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:15.888192 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dde993-23c3-4e7c-a0d3-d8cf095bbc48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:15.907409 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 219/448] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:53:15.908177 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d00a80-f30e-4db0-842d-e0734b782830 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:15.971488 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dde993-23c3-4e7c-a0d3-d8cf095bbc48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:15.973728 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dde993-23c3-4e7c-a0d3-d8cf095bbc48 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:16.007775 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d00a80-f30e-4db0-842d-e0734b782830 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:16.045585 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc1a3b-548f-49cd-bd50-75797ab681e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:16.045585 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc1a3b-548f-49cd-bd50-75797ab681e3 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:16.046336 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc1a3b-548f-49cd-bd50-75797ab681e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:16.046336 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc1a3b-548f-49cd-bd50-75797ab681e3 None admin] PATH_INFO: `/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:16.047999 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc1a3b-548f-49cd-bd50-75797ab681e3 None admin] RBAC: Authorizing `identity:get_project(project_id=7de1a1d5d5f041ddbc5231b5975a3a68)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:16.049637 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc1a3b-548f-49cd-bd50-75797ab681e3 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:16.055686 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 220/449] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:53:15 2022] GET /identity/v3/projects/7de1a1d5d5f041ddbc5231b5975a3a68 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:16.057207 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc1a3b-548f-49cd-bd50-75797ab681e3 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:16.087792 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 230/450] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:53:16.093469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dde993-23c3-4e7c-a0d3-d8cf095bbc48 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:16.166918 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc1a3b-548f-49cd-bd50-75797ab681e3 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:16.190193 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dde993-23c3-4e7c-a0d3-d8cf095bbc48 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:16.198901 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1d326-3de0-491f-8368-2644c417d967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:16.199776 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1d326-3de0-491f-8368-2644c417d967 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:16.200064 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1d326-3de0-491f-8368-2644c417d967 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:16.200329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1d326-3de0-491f-8368-2644c417d967 None admin] PATH_INFO: `/v3/groups/73937900025c470b9e05888ec3705d5e` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:16.201499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1d326-3de0-491f-8368-2644c417d967 None admin] RBAC: Authorizing `identity:get_group(group_id=73937900025c470b9e05888ec3705d5e)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:16.203516 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1d326-3de0-491f-8368-2644c417d967 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:16.205311 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 221/451] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 12 16:53:16 2022] GET /identity/v3/groups/73937900025c470b9e05888ec3705d5e => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:16.210802 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1d326-3de0-491f-8368-2644c417d967 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:16.222173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e8b4d-d695-4bd9-8364-97f6ea9bf7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:16.223019 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e8b4d-d695-4bd9-8364-97f6ea9bf7b2 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:16.223297 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e8b4d-d695-4bd9-8364-97f6ea9bf7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:16.223565 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e8b4d-d695-4bd9-8364-97f6ea9bf7b2 None admin] PATH_INFO: `/v3/projects/3dca91e00e894d69a0b385cea4a3db66` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:16.224770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e8b4d-d695-4bd9-8364-97f6ea9bf7b2 None admin] RBAC: Authorizing `identity:get_project(project_id=3dca91e00e894d69a0b385cea4a3db66)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:16.226470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e8b4d-d695-4bd9-8364-97f6ea9bf7b2 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:16.228293 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 231/452] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 12 16:53:16 2022] GET /identity/v3/projects/3dca91e00e894d69a0b385cea4a3db66 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:16.233498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e8b4d-d695-4bd9-8364-97f6ea9bf7b2 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:16.302545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1d326-3de0-491f-8368-2644c417d967 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:16.324721 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e8b4d-d695-4bd9-8364-97f6ea9bf7b2 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:16.334953 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092a074-9e5c-4d43-ba7a-ebdf23cef32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:16.335574 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092a074-9e5c-4d43-ba7a-ebdf23cef32c None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:16.335879 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092a074-9e5c-4d43-ba7a-ebdf23cef32c None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:16.336151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092a074-9e5c-4d43-ba7a-ebdf23cef32c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:16.336956 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092a074-9e5c-4d43-ba7a-ebdf23cef32c None admin] RBAC: Adding query filter params (group.id=73937900025c470b9e05888ec3705d5e, role.id=f45adb34d54d49558694df72aec6b99d, scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:16.337260 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092a074-9e5c-4d43-ba7a-ebdf23cef32c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:16.338672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c092a074-9e5c-4d43-ba7a-ebdf23cef32c None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:16.344484 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 222/453] 10.222.0.64 () {56 vars in 1376 bytes} [Thu May 12 16:53:16 2022] GET /identity/v3/role_assignments?group.id=73937900025c470b9e05888ec3705d5e&scope.project.id=7de1a1d5d5f041ddbc5231b5975a3a68&role.id=f45adb34d54d49558694df72aec6b99d => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:16.357381 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fcd61-cc8b-4226-b2d8-e0d2259e0c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:16.358748 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fcd61-cc8b-4226-b2d8-e0d2259e0c12 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:16.359030 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fcd61-cc8b-4226-b2d8-e0d2259e0c12 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:16.359305 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fcd61-cc8b-4226-b2d8-e0d2259e0c12 None admin] PATH_INFO: `/v3/groups/4f3791de28374405adcdc70585faa0c6` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:16.360697 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194fcd61-cc8b-4226-b2d8-e0d2259e0c12 None admin] RBAC: Authorizing `identity:get_group(group_id=4f3791de28374405adcdc70585faa0c6)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:16.362201 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194fcd61-cc8b-4226-b2d8-e0d2259e0c12 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:16.363972 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 232/454] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 12 16:53:16 2022] GET /identity/v3/groups/4f3791de28374405adcdc70585faa0c6 => generated 229 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:16.370129 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092a074-9e5c-4d43-ba7a-ebdf23cef32c None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:16.471112 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c092a074-9e5c-4d43-ba7a-ebdf23cef32c None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:16.506868 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcab4b9-a606-467b-a8ac-9490ad900675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:16.507533 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcab4b9-a606-467b-a8ac-9490ad900675 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:16.507847 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcab4b9-a606-467b-a8ac-9490ad900675 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:16.508125 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcab4b9-a606-467b-a8ac-9490ad900675 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:16.508958 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcab4b9-a606-467b-a8ac-9490ad900675 None admin] RBAC: Adding query filter params (group.id=4f3791de28374405adcdc70585faa0c6, role.id=fbd6364b42a641f695c0b265a789057a, scope.project.id=3dca91e00e894d69a0b385cea4a3db66) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:16.509274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcab4b9-a606-467b-a8ac-9490ad900675 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:16.510730 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcab4b9-a606-467b-a8ac-9490ad900675 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:16.516973 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 223/455] 10.222.0.64 () {56 vars in 1376 bytes} [Thu May 12 16:53:16 2022] GET /identity/v3/role_assignments?group.id=4f3791de28374405adcdc70585faa0c6&scope.project.id=3dca91e00e894d69a0b385cea4a3db66&role.id=fbd6364b42a641f695c0b265a789057a => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:19.109071 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc403012-f8a8-4c60-a636-d9bd13f89ffd None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:19.109599 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc403012-f8a8-4c60-a636-d9bd13f89ffd None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:19.109599 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc403012-f8a8-4c60-a636-d9bd13f89ffd None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:19.111277 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 233/456] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:19.117651 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208fbb6-c51b-4eac-af31-1ccbb1911c51 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:19.117651 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208fbb6-c51b-4eac-af31-1ccbb1911c51 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:19.117651 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208fbb6-c51b-4eac-af31-1ccbb1911c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:19.136841 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-5208fbb6-c51b-4eac-af31-1ccbb1911c51 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:19.138378 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-5208fbb6-c51b-4eac-af31-1ccbb1911c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:19.215832 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 224/457] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:53:19.238897 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc403012-f8a8-4c60-a636-d9bd13f89ffd None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:19.328171 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eee83-e745-407a-a5ce-a79bbde3a647 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:19.328807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eee83-e745-407a-a5ce-a79bbde3a647 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:19.329289 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eee83-e745-407a-a5ce-a79bbde3a647 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:19.331114 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 225/458] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:53:19.336516 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c22c79-947f-4604-b7fb-fca14632a504 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:19.337071 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c22c79-947f-4604-b7fb-fca14632a504 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:19.337555 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c22c79-947f-4604-b7fb-fca14632a504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:19.345716 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc403012-f8a8-4c60-a636-d9bd13f89ffd None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:19.354967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-d1c22c79-947f-4604-b7fb-fca14632a504 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:19.356535 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-d1c22c79-947f-4604-b7fb-fca14632a504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:19.387259 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85244a99-46bb-4b29-94fc-225a0212978d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:19.388420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85244a99-46bb-4b29-94fc-225a0212978d None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:19.388906 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85244a99-46bb-4b29-94fc-225a0212978d None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:19.389443 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85244a99-46bb-4b29-94fc-225a0212978d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:19.399585 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85244a99-46bb-4b29-94fc-225a0212978d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:19.401367 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85244a99-46bb-4b29-94fc-225a0212978d None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:19.419084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-85244a99-46bb-4b29-94fc-225a0212978d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:19.419084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:19.419084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:19.419084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:19.419084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:19.419084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:19.419084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:19.419084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:19.419084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:19.419084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:19.419084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:19.419084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:19.419084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:19.419084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:19.419084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:19.420156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:19.420156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:19.420156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:19.420156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:19.420156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:19.420156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:19.420156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:19.420156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:19.420156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:19.420156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:19.420156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:19.420156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:19.420156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:19.420156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:19.420156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:19.420156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:19.420156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:19.421669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:19.421669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:19.421669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:19.421669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:19.423239 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 234/459] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:19.423880 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 226/460] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:53:19.428790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95914872-15c0-43a3-9e89-63556816b067 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:19.429071 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95914872-15c0-43a3-9e89-63556816b067 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:19.429342 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95914872-15c0-43a3-9e89-63556816b067 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:19.430746 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 235/461] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:19.432708 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c22c79-947f-4604-b7fb-fca14632a504 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:19.435676 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee597494-1344-4a1f-8adf-0130a05c5d0f None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:19.436114 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee597494-1344-4a1f-8adf-0130a05c5d0f None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:19.437152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee597494-1344-4a1f-8adf-0130a05c5d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:19.453786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-ee597494-1344-4a1f-8adf-0130a05c5d0f None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:19.455049 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-ee597494-1344-4a1f-8adf-0130a05c5d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:19.520661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 236/462] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:53:19.521931 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee597494-1344-4a1f-8adf-0130a05c5d0f None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:19.542034 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c22c79-947f-4604-b7fb-fca14632a504 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:19.577445 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc1352-3c77-455b-ace4-b64c4fd2db7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:19.578129 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc1352-3c77-455b-ace4-b64c4fd2db7b None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:19.578405 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc1352-3c77-455b-ace4-b64c4fd2db7b None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:19.578692 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cc1352-3c77-455b-ace4-b64c4fd2db7b None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:19.579427 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc1352-3c77-455b-ace4-b64c4fd2db7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:19.579777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc1352-3c77-455b-ace4-b64c4fd2db7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:19.581216 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cc1352-3c77-455b-ace4-b64c4fd2db7b None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:19.598863 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 227/463] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:19.599778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc1352-3c77-455b-ace4-b64c4fd2db7b None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:19.635475 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee597494-1344-4a1f-8adf-0130a05c5d0f None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:19.668971 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c22f0-f511-439c-8d2c-f805670df224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:19.669759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c22f0-f511-439c-8d2c-f805670df224 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:19.670040 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c22f0-f511-439c-8d2c-f805670df224 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:19.670318 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c22f0-f511-439c-8d2c-f805670df224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:19.684393 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c22f0-f511-439c-8d2c-f805670df224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:19.685960 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c22f0-f511-439c-8d2c-f805670df224 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:19.705986 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cc1352-3c77-455b-ace4-b64c4fd2db7b None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:19.710532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-d00c22f0-f511-439c-8d2c-f805670df224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:19.710532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:19.710532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:19.710532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:19.710532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:19.710532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:19.710532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:19.710532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:19.710532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:19.710532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:19.710532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:19.710532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:19.710532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:19.710532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:19.710532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:19.711399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:19.711399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:19.711399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:19.711399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:19.711399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:19.711399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:19.711399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:19.711399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:19.711399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:19.711399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:19.711399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:19.711399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:19.711399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:19.711399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:19.711399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:19.711399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:19.711399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:19.712275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:19.712275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:19.712275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:19.712275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:19.715979 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 237/464] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:19.717307 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c22f0-f511-439c-8d2c-f805670df224 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:19.742225 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c3f35-75f6-4796-9c97-e2142848825a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:19.743962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c3f35-75f6-4796-9c97-e2142848825a None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:19.744432 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c3f35-75f6-4796-9c97-e2142848825a None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:19.745040 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c3f35-75f6-4796-9c97-e2142848825a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:19.758689 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c3f35-75f6-4796-9c97-e2142848825a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:19.761201 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c3f35-75f6-4796-9c97-e2142848825a None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:19.779205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-9a6c3f35-75f6-4796-9c97-e2142848825a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:19.779205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:19.779205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:19.779205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:19.779205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:19.779205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:19.779205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:19.779205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:19.779205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:19.779205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:19.779205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:19.779205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:19.779205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:19.779205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:19.779205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:19.780397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:19.780397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:19.780397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:19.780397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:19.780397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:19.780397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:19.780397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:19.780397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:19.780397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:19.780397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:19.780397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:19.780397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:19.780397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:19.780397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:19.780397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:19.780397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:19.780397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:19.781523 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:19.781523 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:19.781523 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:19.781523 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:19.781523 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 228/465] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:19.781523 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c3f35-75f6-4796-9c97-e2142848825a None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:19.817568 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c22f0-f511-439c-8d2c-f805670df224 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:19.849559 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4a075-5321-45f1-8b3d-1fe03b9f283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:19.850216 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4a075-5321-45f1-8b3d-1fe03b9f283a None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:19.850503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4a075-5321-45f1-8b3d-1fe03b9f283a None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:19.850775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4a075-5321-45f1-8b3d-1fe03b9f283a None admin] PATH_INFO: `/v3/users` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:19.851760 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4a075-5321-45f1-8b3d-1fe03b9f283a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:19.853206 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4a075-5321-45f1-8b3d-1fe03b9f283a None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:19.872524 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 238/466] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 12 16:53:19 2022] POST /identity/v3/users => generated 246 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:53:19.874317 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f552a13-c81d-447f-a6bc-46a1cf983859 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:19.874863 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f552a13-c81d-447f-a6bc-46a1cf983859 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:19.874863 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f552a13-c81d-447f-a6bc-46a1cf983859 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:19.876461 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 239/467] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:19.877236 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f552a13-c81d-447f-a6bc-46a1cf983859 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:19.881837 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c3f35-75f6-4796-9c97-e2142848825a None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:19.918510 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34327ef-aa07-47b3-8787-5ec4e749fc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:19.919247 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34327ef-aa07-47b3-8787-5ec4e749fc81 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:19.919780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34327ef-aa07-47b3-8787-5ec4e749fc81 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:19.919900 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34327ef-aa07-47b3-8787-5ec4e749fc81 None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:19.920639 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34327ef-aa07-47b3-8787-5ec4e749fc81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:19.921017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34327ef-aa07-47b3-8787-5ec4e749fc81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:19.922421 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34327ef-aa07-47b3-8787-5ec4e749fc81 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:19.935826 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 229/468] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:19.937661 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645131b-e594-4243-94fd-303d245dd0f4 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:19.937954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645131b-e594-4243-94fd-303d245dd0f4 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:19.938229 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645131b-e594-4243-94fd-303d245dd0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:19.956434 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-e645131b-e594-4243-94fd-303d245dd0f4 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:19.957682 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-e645131b-e594-4243-94fd-303d245dd0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:19.998501 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f552a13-c81d-447f-a6bc-46a1cf983859 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:20.043746 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 230/469] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:20.043746 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645131b-e594-4243-94fd-303d245dd0f4 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:20.046463 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345da618-5739-4665-9b09-b1c189a0a42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:20.047156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345da618-5739-4665-9b09-b1c189a0a42a None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:20.047441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345da618-5739-4665-9b09-b1c189a0a42a None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:20.047942 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345da618-5739-4665-9b09-b1c189a0a42a None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:20.049117 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345da618-5739-4665-9b09-b1c189a0a42a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:20.049434 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345da618-5739-4665-9b09-b1c189a0a42a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:20.051362 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345da618-5739-4665-9b09-b1c189a0a42a None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:20.065682 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 240/470] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:20.066496 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345da618-5739-4665-9b09-b1c189a0a42a None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:20.143654 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645131b-e594-4243-94fd-303d245dd0f4 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:20.171789 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345da618-5739-4665-9b09-b1c189a0a42a None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:20.177390 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38072008-ce43-46f4-b01e-3a81cccc49df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:20.178068 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38072008-ce43-46f4-b01e-3a81cccc49df None admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:20.178381 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38072008-ce43-46f4-b01e-3a81cccc49df None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:20.178634 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38072008-ce43-46f4-b01e-3a81cccc49df None admin] PATH_INFO: `/v3/users` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:20.179338 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38072008-ce43-46f4-b01e-3a81cccc49df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:20.180829 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38072008-ce43-46f4-b01e-3a81cccc49df None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:20.200658 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 231/471] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 12 16:53:20 2022] POST /identity/v3/users => generated 248 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:53:20.207865 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38072008-ce43-46f4-b01e-3a81cccc49df None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:20.207966 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee5dea-bd59-46e3-9ba5-0fd15da82783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:20.210264 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee5dea-bd59-46e3-9ba5-0fd15da82783 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:20.210264 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee5dea-bd59-46e3-9ba5-0fd15da82783 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:20.210264 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee5dea-bd59-46e3-9ba5-0fd15da82783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:20.220436 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee5dea-bd59-46e3-9ba5-0fd15da82783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:20.221994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee5dea-bd59-46e3-9ba5-0fd15da82783 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:20.242050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-c9ee5dea-bd59-46e3-9ba5-0fd15da82783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:20.242050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:20.242050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:20.242050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:20.242050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:20.242050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:20.242050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:20.242050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:20.242050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:20.242050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:20.242050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:20.242050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:20.242050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:20.242050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:20.242050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:20.242961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:20.242961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:20.242961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:20.242961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:20.242961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:20.242961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:20.242961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:20.242961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:20.242961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:20.242961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:20.242961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:20.242961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:20.242961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:20.242961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:20.242961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:20.242961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:20.242961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:20.243834 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:20.243834 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:20.243834 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:20.243834 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:20.248554 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 241/472] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:20.250341 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee5dea-bd59-46e3-9ba5-0fd15da82783 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:20.329108 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38072008-ce43-46f4-b01e-3a81cccc49df None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:20.359030 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee5dea-bd59-46e3-9ba5-0fd15da82783 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:20.366339 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdc268-2533-448f-a31f-7b599e0340e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:20.367032 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdc268-2533-448f-a31f-7b599e0340e7 None admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:20.367315 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdc268-2533-448f-a31f-7b599e0340e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:20.367592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdc268-2533-448f-a31f-7b599e0340e7 None admin] PATH_INFO: `/v3/users` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:20.368336 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdc268-2533-448f-a31f-7b599e0340e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:20.369836 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdc268-2533-448f-a31f-7b599e0340e7 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:20.397512 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 232/473] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 12 16:53:20 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:53:20.397805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2301c-89bb-4da7-a51f-b4d8e3486588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:20.398356 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2301c-89bb-4da7-a51f-b4d8e3486588 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:20.398717 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2301c-89bb-4da7-a51f-b4d8e3486588 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:20.399002 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2301c-89bb-4da7-a51f-b4d8e3486588 None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:20.401149 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2301c-89bb-4da7-a51f-b4d8e3486588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:20.401149 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2301c-89bb-4da7-a51f-b4d8e3486588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:20.401671 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2301c-89bb-4da7-a51f-b4d8e3486588 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:20.416459 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 242/474] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:20.423003 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdc268-2533-448f-a31f-7b599e0340e7 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:20.543562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdc268-2533-448f-a31f-7b599e0340e7 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:20.580714 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602df0ba-fec0-4e2c-b9e3-a0d10c114933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:20.581319 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602df0ba-fec0-4e2c-b9e3-a0d10c114933 None admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:20.581602 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602df0ba-fec0-4e2c-b9e3-a0d10c114933 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:20.581881 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602df0ba-fec0-4e2c-b9e3-a0d10c114933 None admin] PATH_INFO: `/v3/users` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:20.582600 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602df0ba-fec0-4e2c-b9e3-a0d10c114933 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:20.584131 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602df0ba-fec0-4e2c-b9e3-a0d10c114933 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:20.615133 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 233/475] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 12 16:53:20 2022] POST /identity/v3/users => generated 249 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:53:22.406605 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba5e4e-b911-4e4e-9d71-a7e45224cce7 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:22.407429 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba5e4e-b911-4e4e-9d71-a7e45224cce7 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:22.407429 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba5e4e-b911-4e4e-9d71-a7e45224cce7 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:22.408951 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 243/476] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:22.415495 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ead68-9d49-4184-a4ae-c4c97cec0803 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:22.416032 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ead68-9d49-4184-a4ae-c4c97cec0803 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:22.416105 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ead68-9d49-4184-a4ae-c4c97cec0803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:22.442788 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-064ead68-9d49-4184-a4ae-c4c97cec0803 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:22.444709 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-064ead68-9d49-4184-a4ae-c4c97cec0803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:22.515863 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 234/477] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:22.544184 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba5e4e-b911-4e4e-9d71-a7e45224cce7 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:22.626667 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f8a5c-481b-4e0f-9c8c-0454bfd91c80 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:22.627000 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f8a5c-481b-4e0f-9c8c-0454bfd91c80 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:22.627224 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f8a5c-481b-4e0f-9c8c-0454bfd91c80 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:22.629006 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 235/478] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:22.635156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed8c49-8d29-4abf-80f9-0d4351b34461 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:22.635156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed8c49-8d29-4abf-80f9-0d4351b34461 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:22.635403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed8c49-8d29-4abf-80f9-0d4351b34461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:22.653584 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-28ed8c49-8d29-4abf-80f9-0d4351b34461 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:22.656403 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba5e4e-b911-4e4e-9d71-a7e45224cce7 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:22.659141 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-28ed8c49-8d29-4abf-80f9-0d4351b34461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:22.691657 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46819797-e0c3-40e4-8dfa-371e21c317c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:22.692468 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46819797-e0c3-40e4-8dfa-371e21c317c7 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:22.692749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46819797-e0c3-40e4-8dfa-371e21c317c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:22.693024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46819797-e0c3-40e4-8dfa-371e21c317c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:22.706805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46819797-e0c3-40e4-8dfa-371e21c317c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:22.716523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-46819797-e0c3-40e4-8dfa-371e21c317c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:22.716523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:22.716523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:22.716523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:22.716523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:22.716523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:22.716523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:22.716523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:22.716523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:22.716523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:22.716523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:22.716523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:22.716523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:22.716523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:22.716523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:22.716523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:22.717514 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:22.717514 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:22.717514 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:22.717514 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:22.717514 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:22.717514 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:22.717514 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:22.717514 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:22.717514 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:22.717514 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:22.717514 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:22.717514 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:22.717514 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:22.717514 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:22.717514 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:22.717514 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:22.718347 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:22.718347 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:22.718347 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:22.718347 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:22.718347 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:22.718347 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:22.718347 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:22.718347 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:22.718347 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:22.718347 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:22.718347 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:22.718347 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:22.718956 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 244/479] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 12 16:53:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:22.724623 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46819797-e0c3-40e4-8dfa-371e21c317c7 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:22.743790 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 236/480] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:22.760850 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed8c49-8d29-4abf-80f9-0d4351b34461 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:22.850383 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46819797-e0c3-40e4-8dfa-371e21c317c7 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:22.866145 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed8c49-8d29-4abf-80f9-0d4351b34461 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:22.883127 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a2a40-dfe3-4333-8020-66d2537a6b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:22.883831 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a2a40-dfe3-4333-8020-66d2537a6b20 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:22.884115 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a2a40-dfe3-4333-8020-66d2537a6b20 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:22.884389 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a2a40-dfe3-4333-8020-66d2537a6b20 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:22.885129 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a2a40-dfe3-4333-8020-66d2537a6b20 None admin] RBAC: Adding query filter params (name=service) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:22.885447 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a2a40-dfe3-4333-8020-66d2537a6b20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:22.886834 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a2a40-dfe3-4333-8020-66d2537a6b20 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:22.895363 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 245/481] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 12 16:53:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:22.900431 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee41327-f189-4bdc-9a9c-64d91546a005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:22.901197 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975feecd-ef90-4fca-a6c2-b1746e81bd67 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:22.901493 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975feecd-ef90-4fca-a6c2-b1746e81bd67 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:22.901786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975feecd-ef90-4fca-a6c2-b1746e81bd67 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:22.902298 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee41327-f189-4bdc-9a9c-64d91546a005 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:22.902759 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee41327-f189-4bdc-9a9c-64d91546a005 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:22.903181 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 246/482] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:22.903383 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee41327-f189-4bdc-9a9c-64d91546a005 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:22.903986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975feecd-ef90-4fca-a6c2-b1746e81bd67 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:22.925098 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee41327-f189-4bdc-9a9c-64d91546a005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:22.933389 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-3ee41327-f189-4bdc-9a9c-64d91546a005 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:22.933389 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:22.933389 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:22.933389 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:22.933389 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:22.933389 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:22.933389 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:22.933389 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:22.933389 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:22.933389 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:22.933389 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:22.933389 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:22.933389 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:22.933389 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:22.933389 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:22.933389 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:22.934608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:22.934608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:22.934608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:22.934608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:22.934608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:22.934608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:22.934608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:22.934608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:22.934608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:22.934608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:22.934608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:22.934608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:22.934608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:22.934608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:22.934608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:22.934608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:22.935571 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:22.935571 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:22.935571 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:22.935571 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:22.935571 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:22.935571 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:22.935571 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:22.935571 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:22.935571 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:22.935571 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:22.935571 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:22.935571 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:22.942981 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 237/483] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 12 16:53:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:53:22.944484 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496c042-ede6-4c9f-b014-94bf8f98a96d None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:22.944928 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496c042-ede6-4c9f-b014-94bf8f98a96d None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:22.945343 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d496c042-ede6-4c9f-b014-94bf8f98a96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:22.961995 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-d496c042-ede6-4c9f-b014-94bf8f98a96d None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:22.963359 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-d496c042-ede6-4c9f-b014-94bf8f98a96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:23.011032 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975feecd-ef90-4fca-a6c2-b1746e81bd67 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:23.035862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 238/484] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:23.035862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496c042-ede6-4c9f-b014-94bf8f98a96d None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:23.055594 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a34f6e-397d-4242-af1c-f1582eec28d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:23.056426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a34f6e-397d-4242-af1c-f1582eec28d6 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:23.056706 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a34f6e-397d-4242-af1c-f1582eec28d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:23.057005 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a34f6e-397d-4242-af1c-f1582eec28d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:23.068168 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a34f6e-397d-4242-af1c-f1582eec28d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:23.069672 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a34f6e-397d-4242-af1c-f1582eec28d6 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:23.087690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-30a34f6e-397d-4242-af1c-f1582eec28d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:23.087690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:23.087690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:23.087690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:23.087690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:23.087690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:23.087690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:23.087690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:23.087690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:23.087690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:23.087690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:23.087690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:23.087690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:23.087690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:23.087690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:23.088539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:23.088539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:23.088539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:23.088539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:23.088539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:23.088539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:23.088539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:23.088539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:23.088539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:23.088539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:23.088539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:23.088539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:23.088539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:23.088539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:23.088539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:23.088539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:23.088539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:23.089338 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:23.089338 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:23.089338 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:23.089338 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:23.093218 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 247/485] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:23.093218 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a34f6e-397d-4242-af1c-f1582eec28d6 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:23.136829 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d496c042-ede6-4c9f-b014-94bf8f98a96d None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:23.172294 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62912466-f263-4ad0-8519-bf69ab33ff2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:23.172906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62912466-f263-4ad0-8519-bf69ab33ff2b None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:23.173208 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62912466-f263-4ad0-8519-bf69ab33ff2b None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:23.173504 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62912466-f263-4ad0-8519-bf69ab33ff2b None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:23.174251 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62912466-f263-4ad0-8519-bf69ab33ff2b None admin] RBAC: Adding query filter params (name=service) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:23.174556 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62912466-f263-4ad0-8519-bf69ab33ff2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:23.176003 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62912466-f263-4ad0-8519-bf69ab33ff2b None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:23.183586 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 239/486] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 12 16:53:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:23.184392 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62912466-f263-4ad0-8519-bf69ab33ff2b None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:23.187124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a34f6e-397d-4242-af1c-f1582eec28d6 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:23.218482 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab26fb-7b47-40f9-a286-41e068f6c62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:23.219265 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab26fb-7b47-40f9-a286-41e068f6c62d None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:23.219543 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab26fb-7b47-40f9-a286-41e068f6c62d None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:23.219846 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab26fb-7b47-40f9-a286-41e068f6c62d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:23.229726 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab26fb-7b47-40f9-a286-41e068f6c62d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:23.237887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-ebab26fb-7b47-40f9-a286-41e068f6c62d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:23.237887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:23.237887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:23.237887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:23.237887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:23.237887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:23.237887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:23.237887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:23.237887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:23.237887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:23.237887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:23.237887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:23.237887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:23.237887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:23.237887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:23.237887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:23.238786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:23.238786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:23.238786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:23.238786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:23.238786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:23.238786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:23.238786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:23.238786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:23.238786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:23.238786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:23.238786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:23.238786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:23.238786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:23.238786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:23.238786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:23.238786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:23.239559 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:23.239559 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:23.239559 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:23.239559 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:23.239559 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:23.239559 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:23.239559 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:23.239559 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:23.239559 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:23.239559 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:23.239559 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:23.239559 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:23.239559 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 248/487] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 12 16:53:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:23.240347 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86d3fd-197d-4b5b-86d6-8431a7460f87 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:23.240613 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86d3fd-197d-4b5b-86d6-8431a7460f87 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:23.240891 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86d3fd-197d-4b5b-86d6-8431a7460f87 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:23.242124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 249/488] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:23.242826 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86d3fd-197d-4b5b-86d6-8431a7460f87 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:23.284729 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62912466-f263-4ad0-8519-bf69ab33ff2b None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:23.316593 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072418b-90fd-42be-a6e1-0247b221d3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:23.317245 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072418b-90fd-42be-a6e1-0247b221d3d8 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:23.317525 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072418b-90fd-42be-a6e1-0247b221d3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:23.317796 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072418b-90fd-42be-a6e1-0247b221d3d8 None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:23.318508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072418b-90fd-42be-a6e1-0247b221d3d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:23.318812 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072418b-90fd-42be-a6e1-0247b221d3d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:23.320220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072418b-90fd-42be-a6e1-0247b221d3d8 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:23.331345 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 240/489] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:23.332162 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072418b-90fd-42be-a6e1-0247b221d3d8 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:23.342994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86d3fd-197d-4b5b-86d6-8431a7460f87 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:23.375499 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966bdcd-e538-45bb-b54a-d1a75d1d5b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:23.376303 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966bdcd-e538-45bb-b54a-d1a75d1d5b36 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:23.376589 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966bdcd-e538-45bb-b54a-d1a75d1d5b36 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:23.376864 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966bdcd-e538-45bb-b54a-d1a75d1d5b36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:23.386837 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966bdcd-e538-45bb-b54a-d1a75d1d5b36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:23.388315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966bdcd-e538-45bb-b54a-d1a75d1d5b36 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:23.404648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-e966bdcd-e538-45bb-b54a-d1a75d1d5b36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:23.404648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:23.404648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:23.404648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:23.404648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:23.404648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:23.404648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:23.404648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:23.404648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:23.404648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:23.404648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:23.404648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:23.404648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:23.404648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:23.404648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:23.405549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:23.405549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:23.405549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:23.405549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:23.405549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:23.405549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:23.405549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:23.405549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:23.405549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:23.405549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:23.405549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:23.405549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:23.405549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:23.405549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:23.405549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:23.405549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:23.405549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:23.406387 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:23.406387 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:23.406387 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:23.406387 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:23.406387 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 250/490] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:23.407034 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387a833-2097-46d7-a57a-b82be60abc9f None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:23.407561 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387a833-2097-46d7-a57a-b82be60abc9f None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:23.407561 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387a833-2097-46d7-a57a-b82be60abc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:23.423497 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-0387a833-2097-46d7-a57a-b82be60abc9f None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:23.424691 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-0387a833-2097-46d7-a57a-b82be60abc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:23.429083 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072418b-90fd-42be-a6e1-0247b221d3d8 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:23.461161 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ce90d-3c76-4d77-b23e-a7db4f2abde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:23.461820 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ce90d-3c76-4d77-b23e-a7db4f2abde8 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:23.462101 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ce90d-3c76-4d77-b23e-a7db4f2abde8 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:23.462376 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ce90d-3c76-4d77-b23e-a7db4f2abde8 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:23.463114 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ce90d-3c76-4d77-b23e-a7db4f2abde8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:23.463425 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ce90d-3c76-4d77-b23e-a7db4f2abde8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:23.464833 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ce90d-3c76-4d77-b23e-a7db4f2abde8 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:23.472969 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 241/491] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 12 16:53:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:23.473756 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ce90d-3c76-4d77-b23e-a7db4f2abde8 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:23.488934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 251/492] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:23.489774 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387a833-2097-46d7-a57a-b82be60abc9f None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:23.567897 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ce90d-3c76-4d77-b23e-a7db4f2abde8 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:23.583503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387a833-2097-46d7-a57a-b82be60abc9f None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:23.599213 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120534e-2b66-48dc-be1a-cfb9ee67f40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:23.600018 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120534e-2b66-48dc-be1a-cfb9ee67f40f None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:23.600315 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120534e-2b66-48dc-be1a-cfb9ee67f40f None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:23.600566 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120534e-2b66-48dc-be1a-cfb9ee67f40f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:23.607884 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120534e-2b66-48dc-be1a-cfb9ee67f40f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:23.609308 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120534e-2b66-48dc-be1a-cfb9ee67f40f None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:23.615257 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf14036-9b62-46a8-9373-edb15845243b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:23.615937 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf14036-9b62-46a8-9373-edb15845243b None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:23.616220 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf14036-9b62-46a8-9373-edb15845243b None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:23.616493 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf14036-9b62-46a8-9373-edb15845243b None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:23.617212 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf14036-9b62-46a8-9373-edb15845243b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:23.617518 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf14036-9b62-46a8-9373-edb15845243b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:23.618878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf14036-9b62-46a8-9373-edb15845243b None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:23.624573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-a120534e-2b66-48dc-be1a-cfb9ee67f40f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 16:53:23.624573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:23.624573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:23.624573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:23.624573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:23.624573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:23.624573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:23.624573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:23.624573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:23.624573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:23.624573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:23.624573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:23.624573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:53:23.624573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:53:23.624573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:53:23.624573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:53:23.625568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:23.625568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:23.625568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:53:23.625568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:23.625568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:53:23.625568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:23.625568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:23.625568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:23.625568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:23.625568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:23.625568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:23.625568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:23.625568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:23.625568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:23.625568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:23.625568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:23.625568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:23.625568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:23.631205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:23.631205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:23.631205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:53:23.631205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:53:23.631205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:53:23.631205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:53:23.631205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:53:23.631205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:53:23.631205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 16:53:23.631205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:23.631205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 242/493] 10.222.0.64 () {56 vars in 1093 bytes} [Thu May 12 16:53:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:23.631205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120534e-2b66-48dc-be1a-cfb9ee67f40f None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:23.631960 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 252/494] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:23.631960 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf14036-9b62-46a8-9373-edb15845243b None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:23.725391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf14036-9b62-46a8-9373-edb15845243b None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:23.727599 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120534e-2b66-48dc-be1a-cfb9ee67f40f None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:23.756970 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a4c20-d072-4b05-b037-218da646d5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:23.757751 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a4c20-d072-4b05-b037-218da646d5f9 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:23.758032 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a4c20-d072-4b05-b037-218da646d5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:23.758304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a4c20-d072-4b05-b037-218da646d5f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:23.759348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cfa6a-025a-44f6-ac12-7023d07826cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:23.760208 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cfa6a-025a-44f6-ac12-7023d07826cf None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:23.760491 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cfa6a-025a-44f6-ac12-7023d07826cf None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:23.760772 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cfa6a-025a-44f6-ac12-7023d07826cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:23.768150 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a4c20-d072-4b05-b037-218da646d5f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:23.775675 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cfa6a-025a-44f6-ac12-7023d07826cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:23.775882 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-a42a4c20-d072-4b05-b037-218da646d5f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:23.775882 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:23.775882 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:23.775882 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:23.775882 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:23.775882 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:23.775882 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:23.775882 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:23.775882 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:23.775882 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:23.775882 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:23.775882 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:23.775882 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:23.775882 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:23.775882 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:23.775882 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:23.776885 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:23.776885 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:23.776885 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:23.776885 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:23.776885 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:23.776885 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:23.776885 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:23.776885 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:23.776885 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:23.776885 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:23.776885 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:23.776885 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:23.776885 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:23.776885 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:23.776885 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:23.776885 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:23.777878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:23.777878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:23.777878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:23.777878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:23.777878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:23.777878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:23.777878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:23.777878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:23.777878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:23.777878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:23.777878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:23.777878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:23.777878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 253/495] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 12 16:53:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:23.778718 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407cfa6a-025a-44f6-ac12-7023d07826cf None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:23.778787 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a4c20-d072-4b05-b037-218da646d5f9 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:23.796747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-407cfa6a-025a-44f6-ac12-7023d07826cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:23.796747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:23.796747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:23.796747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:23.796747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:23.796747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:23.796747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:23.796747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:23.796747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:23.796747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:23.796747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:23.796747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:23.796747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:23.796747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:23.796747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:23.797592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:23.797592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:23.797592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:23.797592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:23.797592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:23.797592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:23.797592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:23.797592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:23.797592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:23.797592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:23.797592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:23.797592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:23.797592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:23.797592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:23.797592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:23.797592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:23.797592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:23.798415 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:23.798415 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:23.798415 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:23.798415 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:23.798415 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 243/496] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:23.799111 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cfa6a-025a-44f6-ac12-7023d07826cf None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:23.872621 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a4c20-d072-4b05-b037-218da646d5f9 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:23.895033 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cfa6a-025a-44f6-ac12-7023d07826cf None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:23.903913 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25761f-51b2-41ee-a0c0-3556ff9ee470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:23.904572 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25761f-51b2-41ee-a0c0-3556ff9ee470 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:23.904916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25761f-51b2-41ee-a0c0-3556ff9ee470 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:23.905217 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25761f-51b2-41ee-a0c0-3556ff9ee470 None admin] PATH_INFO: `/v3/users` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:23.906055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25761f-51b2-41ee-a0c0-3556ff9ee470 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:23.906364 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25761f-51b2-41ee-a0c0-3556ff9ee470 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:23.907843 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25761f-51b2-41ee-a0c0-3556ff9ee470 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:23.927667 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f86c34-6d37-4c79-a176-b0989445e9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:23.928449 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f86c34-6d37-4c79-a176-b0989445e9ee None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:23.928726 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f86c34-6d37-4c79-a176-b0989445e9ee None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:23.928995 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f86c34-6d37-4c79-a176-b0989445e9ee None admin] PATH_INFO: `/v3/users/glance` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:23.936253 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f86c34-6d37-4c79-a176-b0989445e9ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:23.937691 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f86c34-6d37-4c79-a176-b0989445e9ee None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:23.943556 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 254/497] 10.222.0.64 () {56 vars in 1133 bytes} [Thu May 12 16:53:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:23.944426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25761f-51b2-41ee-a0c0-3556ff9ee470 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:23.952132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-14f86c34-6d37-4c79-a176-b0989445e9ee None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 16:53:23.952132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:23.952132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:23.952132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:23.952132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:23.952132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:23.952132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:23.952132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:23.952132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:23.952132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:23.952132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:23.952132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:23.952132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:53:23.952132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:53:23.952132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:53:23.952132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:53:23.953169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:23.953169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:23.953169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:53:23.953169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:23.953169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:53:23.953169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:23.953169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:23.953169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:23.953169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:23.953169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:23.953169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:23.953169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:23.953169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:23.953169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:23.953169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:23.953169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:23.953169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:23.953169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:23.954261 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:23.954261 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:23.954261 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:53:23.954261 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:53:23.954261 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:53:23.954261 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:53:23.954261 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:53:23.954261 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:53:23.954261 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 16:53:23.954261 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:23.954261 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 244/498] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:53:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:23.954261 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f86c34-6d37-4c79-a176-b0989445e9ee None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:24.039496 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25761f-51b2-41ee-a0c0-3556ff9ee470 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:24.048751 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f86c34-6d37-4c79-a176-b0989445e9ee None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:24.070739 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838b6ca-0efb-4de4-bab9-48853fa67860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:24.071391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838b6ca-0efb-4de4-bab9-48853fa67860 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:24.071718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838b6ca-0efb-4de4-bab9-48853fa67860 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:24.071994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838b6ca-0efb-4de4-bab9-48853fa67860 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:24.072755 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838b6ca-0efb-4de4-bab9-48853fa67860 None admin] RBAC: Adding query filter params (name=service) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:24.073059 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838b6ca-0efb-4de4-bab9-48853fa67860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:24.074445 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838b6ca-0efb-4de4-bab9-48853fa67860 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:24.080521 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777794a-bd4c-4281-af0a-c19904f1eddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:24.081164 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777794a-bd4c-4281-af0a-c19904f1eddd None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:24.081443 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777794a-bd4c-4281-af0a-c19904f1eddd None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:24.081718 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777794a-bd4c-4281-af0a-c19904f1eddd None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:24.082457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777794a-bd4c-4281-af0a-c19904f1eddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:24.082657 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 255/499] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 12 16:53:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:24.082756 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777794a-bd4c-4281-af0a-c19904f1eddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:24.083449 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838b6ca-0efb-4de4-bab9-48853fa67860 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:24.084144 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777794a-bd4c-4281-af0a-c19904f1eddd None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:24.095659 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 245/500] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:24.095659 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777794a-bd4c-4281-af0a-c19904f1eddd None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:24.177465 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838b6ca-0efb-4de4-bab9-48853fa67860 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:24.188432 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777794a-bd4c-4281-af0a-c19904f1eddd None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:24.208528 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e70d7-9320-41a3-a42c-335d66431a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:24.209171 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e70d7-9320-41a3-a42c-335d66431a60 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:24.209452 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e70d7-9320-41a3-a42c-335d66431a60 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:24.209728 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e70d7-9320-41a3-a42c-335d66431a60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:24.220286 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4c5f6-93ef-4557-bef6-762dca13b384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:24.220944 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4c5f6-93ef-4557-bef6-762dca13b384 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:24.221227 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4c5f6-93ef-4557-bef6-762dca13b384 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:24.221497 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4c5f6-93ef-4557-bef6-762dca13b384 None admin] PATH_INFO: `/v3/users` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:24.222349 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4c5f6-93ef-4557-bef6-762dca13b384 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:24.222657 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4c5f6-93ef-4557-bef6-762dca13b384 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:24.224134 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4c5f6-93ef-4557-bef6-762dca13b384 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:24.259705 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 246/501] 10.222.0.64 () {56 vars in 1137 bytes} [Thu May 12 16:53:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:24.260512 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4c5f6-93ef-4557-bef6-762dca13b384 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:24.273372 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e70d7-9320-41a3-a42c-335d66431a60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:24.274861 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e70d7-9320-41a3-a42c-335d66431a60 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:24.352299 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4c5f6-93ef-4557-bef6-762dca13b384 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:24.365700 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 256/502] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:53:24.366542 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e70d7-9320-41a3-a42c-335d66431a60 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:24.384360 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6735b-af9e-4307-bffe-b012e61cd831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:24.385141 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6735b-af9e-4307-bffe-b012e61cd831 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:24.385424 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6735b-af9e-4307-bffe-b012e61cd831 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:24.385693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6735b-af9e-4307-bffe-b012e61cd831 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:24.395742 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6735b-af9e-4307-bffe-b012e61cd831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:24.397196 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6735b-af9e-4307-bffe-b012e61cd831 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:24.413778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-a5f6735b-af9e-4307-bffe-b012e61cd831 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:24.413778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:24.413778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:24.413778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:24.413778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:24.413778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:24.413778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:24.413778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:24.413778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:24.413778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:24.413778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:24.413778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:24.413778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:24.413778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:24.413778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:24.414765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:24.414765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:24.414765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:24.414765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:24.414765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:24.414765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:24.414765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:24.414765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:24.414765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:24.414765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:24.414765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:24.414765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:24.414765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:24.414765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:24.414765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:24.414765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:24.414765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:24.420714 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:24.420714 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:24.420714 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:24.420714 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:24.420714 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 247/503] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:24.420714 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6735b-af9e-4307-bffe-b012e61cd831 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:24.458942 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e70d7-9320-41a3-a42c-335d66431a60 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:24.490841 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4b029-0a92-4b71-b6b2-d1e37b32d229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:24.491619 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4b029-0a92-4b71-b6b2-d1e37b32d229 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:24.491931 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4b029-0a92-4b71-b6b2-d1e37b32d229 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:24.492205 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4b029-0a92-4b71-b6b2-d1e37b32d229 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:24.499414 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4b029-0a92-4b71-b6b2-d1e37b32d229 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:24.500896 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4b029-0a92-4b71-b6b2-d1e37b32d229 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:24.512237 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6735b-af9e-4307-bffe-b012e61cd831 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:24.516752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-66a4b029-0a92-4b71-b6b2-d1e37b32d229 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 16:53:24.516752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:24.516752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:24.516752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:24.516752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:24.516752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:24.516752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:24.516752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:24.516752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:24.516752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:24.516752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:24.516752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:24.516752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:53:24.516752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:53:24.516752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:53:24.516752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:53:24.517775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:24.517775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:24.517775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:53:24.517775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:24.517775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:53:24.517775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:24.517775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:24.517775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:24.517775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:24.517775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:24.517775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:24.517775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:24.517775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:24.517775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:24.517775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:24.517775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:24.517775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:24.517775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:24.518842 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:24.518842 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:24.518842 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:53:24.518842 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:53:24.518842 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:53:24.518842 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:53:24.518842 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:53:24.518842 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:53:24.518842 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 16:53:24.518842 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:24.518842 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 257/504] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:53:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:24.518842 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4b029-0a92-4b71-b6b2-d1e37b32d229 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:24.544433 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fadb7-f341-47e7-8a98-23cb6926ab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:24.545102 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fadb7-f341-47e7-8a98-23cb6926ab62 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:24.545408 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fadb7-f341-47e7-8a98-23cb6926ab62 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:24.545677 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fadb7-f341-47e7-8a98-23cb6926ab62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:24.609099 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fadb7-f341-47e7-8a98-23cb6926ab62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:24.610512 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fadb7-f341-47e7-8a98-23cb6926ab62 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:24.615691 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4b029-0a92-4b71-b6b2-d1e37b32d229 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:24.648689 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3791f8-3c53-44e0-b4c1-122ee321a66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:24.649464 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3791f8-3c53-44e0-b4c1-122ee321a66c None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:24.649744 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3791f8-3c53-44e0-b4c1-122ee321a66c None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:24.650019 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3791f8-3c53-44e0-b4c1-122ee321a66c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:24.660050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3791f8-3c53-44e0-b4c1-122ee321a66c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:24.661511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3791f8-3c53-44e0-b4c1-122ee321a66c None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:24.679790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-7c3791f8-3c53-44e0-b4c1-122ee321a66c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:24.679790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:24.679790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:24.679790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:24.679790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:24.679790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:24.679790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:24.679790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:24.679790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:24.679790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:24.679790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:24.679790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:24.679790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:24.679790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:24.679790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:24.680769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:24.680769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:24.680769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:24.680769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:24.680769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:24.680769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:24.680769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:24.680769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:24.680769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:24.680769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:24.680769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:24.680769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:24.680769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:24.680769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:24.680769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:24.680769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:24.680769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:24.681648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:24.681648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:24.681648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:24.681648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:24.681648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 258/505] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:24.682213 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3791f8-3c53-44e0-b4c1-122ee321a66c None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:24.708147 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 248/506] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:53:24.708147 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fadb7-f341-47e7-8a98-23cb6926ab62 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:24.775473 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3791f8-3c53-44e0-b4c1-122ee321a66c None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:24.798131 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fadb7-f341-47e7-8a98-23cb6926ab62 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:24.815755 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b2294-2300-4ddc-b350-06a93af47fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:24.816424 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b2294-2300-4ddc-b350-06a93af47fee None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:24.816710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b2294-2300-4ddc-b350-06a93af47fee None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:24.817036 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b2294-2300-4ddc-b350-06a93af47fee None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:24.818289 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b2294-2300-4ddc-b350-06a93af47fee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:24.818789 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b2294-2300-4ddc-b350-06a93af47fee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:24.821068 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6b2294-2300-4ddc-b350-06a93af47fee None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:24.835287 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5788b-9b61-422f-bf49-34534365e905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:24.835982 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5788b-9b61-422f-bf49-34534365e905 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:24.836272 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5788b-9b61-422f-bf49-34534365e905 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:24.836490 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 259/507] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:24.836601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5788b-9b61-422f-bf49-34534365e905 None admin] PATH_INFO: `/v3/users` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:24.837312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b2294-2300-4ddc-b350-06a93af47fee None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:24.837410 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5788b-9b61-422f-bf49-34534365e905 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:24.837678 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5788b-9b61-422f-bf49-34534365e905 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:24.839102 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5788b-9b61-422f-bf49-34534365e905 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:24.856110 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 249/508] 10.222.0.64 () {56 vars in 1137 bytes} [Thu May 12 16:53:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:24.856941 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5788b-9b61-422f-bf49-34534365e905 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:24.932795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b2294-2300-4ddc-b350-06a93af47fee None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:24.950966 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5788b-9b61-422f-bf49-34534365e905 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:24.963837 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54548100-a602-452f-aac1-e1ee06c925ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:24.964486 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54548100-a602-452f-aac1-e1ee06c925ae None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:24.964760 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54548100-a602-452f-aac1-e1ee06c925ae None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:24.965033 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54548100-a602-452f-aac1-e1ee06c925ae None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:24.965736 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54548100-a602-452f-aac1-e1ee06c925ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:24.966034 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54548100-a602-452f-aac1-e1ee06c925ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:24.967921 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54548100-a602-452f-aac1-e1ee06c925ae None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:24.979139 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 260/509] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:24.979957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54548100-a602-452f-aac1-e1ee06c925ae None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:24.987019 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e11874-6da9-4cbe-9117-11b68ad3d93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:24.987835 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e11874-6da9-4cbe-9117-11b68ad3d93c None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:24.988118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e11874-6da9-4cbe-9117-11b68ad3d93c None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:24.988396 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e11874-6da9-4cbe-9117-11b68ad3d93c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:24.998151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e11874-6da9-4cbe-9117-11b68ad3d93c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:25.000302 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e11874-6da9-4cbe-9117-11b68ad3d93c None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:25.017173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-91e11874-6da9-4cbe-9117-11b68ad3d93c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:25.017173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:25.017173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:25.017173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:25.017173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:25.017173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:25.017173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:25.017173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:25.017173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:25.017173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:25.017173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:25.017173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:25.017173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:25.017173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:25.017173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:25.017987 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:25.017987 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:25.017987 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:25.017987 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:25.017987 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:25.017987 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:25.017987 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:25.017987 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:25.017987 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:25.017987 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:25.017987 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:25.017987 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:25.017987 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:25.017987 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:25.017987 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:25.017987 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:25.017987 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:25.018915 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:25.018915 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:25.018915 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:25.018915 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:25.018915 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 250/510] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:25.019189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e11874-6da9-4cbe-9117-11b68ad3d93c None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:25.076576 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54548100-a602-452f-aac1-e1ee06c925ae None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:25.108684 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671614e-c65c-467e-bfc7-5f32833eb437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:25.109478 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671614e-c65c-467e-bfc7-5f32833eb437 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:25.109759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671614e-c65c-467e-bfc7-5f32833eb437 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:25.110034 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671614e-c65c-467e-bfc7-5f32833eb437 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:25.114581 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e11874-6da9-4cbe-9117-11b68ad3d93c None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:25.116693 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671614e-c65c-467e-bfc7-5f32833eb437 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:25.118135 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671614e-c65c-467e-bfc7-5f32833eb437 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:25.132749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-a671614e-c65c-467e-bfc7-5f32833eb437 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 16:53:25.132749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:25.132749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:25.132749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:25.132749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:25.132749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:25.132749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:25.132749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:25.132749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:25.132749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:25.132749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:25.132749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:25.132749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:53:25.132749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:53:25.132749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:53:25.132749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:53:25.133639 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:25.133639 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:25.133639 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:53:25.133639 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:25.133639 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:53:25.133639 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:25.133639 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:25.133639 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:25.133639 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:25.133639 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:25.133639 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:25.133639 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:25.133639 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:25.133639 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:25.133639 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:25.133639 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:25.133639 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:25.133639 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:25.134507 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:25.134507 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:25.134507 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:53:25.134507 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:53:25.134507 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:53:25.134507 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:53:25.134507 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:53:25.134507 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:53:25.134507 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 16:53:25.134507 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:25.134507 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 261/511] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 12 16:53:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:25.135059 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671614e-c65c-467e-bfc7-5f32833eb437 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:25.151766 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c49d7-291d-4b0c-b80c-7b79682d9c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:25.152415 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c49d7-291d-4b0c-b80c-7b79682d9c89 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:25.152704 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c49d7-291d-4b0c-b80c-7b79682d9c89 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:25.152982 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c49d7-291d-4b0c-b80c-7b79682d9c89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:25.222781 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c49d7-291d-4b0c-b80c-7b79682d9c89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:25.224222 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c49d7-291d-4b0c-b80c-7b79682d9c89 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:25.230430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671614e-c65c-467e-bfc7-5f32833eb437 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:25.262214 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c854a67-2281-45c8-9695-bc99f59913f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:25.263000 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c854a67-2281-45c8-9695-bc99f59913f8 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:25.263280 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c854a67-2281-45c8-9695-bc99f59913f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:25.263555 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c854a67-2281-45c8-9695-bc99f59913f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:25.269975 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c854a67-2281-45c8-9695-bc99f59913f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:25.271411 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c854a67-2281-45c8-9695-bc99f59913f8 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:25.285888 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-6c854a67-2281-45c8-9695-bc99f59913f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:25.285888 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:25.285888 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:25.285888 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:25.285888 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:25.285888 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:25.285888 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:25.285888 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:25.285888 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:25.285888 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:25.285888 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:25.285888 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:25.285888 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:53:25.285888 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:53:25.285888 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:53:25.286718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:53:25.286718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:25.286718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:25.286718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:25.286718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:25.286718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:25.286718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:25.286718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:25.286718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:25.286718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:25.286718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:25.286718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:25.286718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:25.286718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:25.286718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:25.286718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:25.286718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:25.287529 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:53:25.287529 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:53:25.287529 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:53:25.287529 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:53:25.287529 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:53:25.287529 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:53:25.287529 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:25.287529 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:25.288630 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 262/512] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:25.289078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c854a67-2281-45c8-9695-bc99f59913f8 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:25.316404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 251/513] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:53:25.317235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c49d7-291d-4b0c-b80c-7b79682d9c89 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:25.382489 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c854a67-2281-45c8-9695-bc99f59913f8 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:25.409189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c49d7-291d-4b0c-b80c-7b79682d9c89 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:25.414311 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718e2a1-3e05-4c88-86e9-aeb62bf4229b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:25.414962 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718e2a1-3e05-4c88-86e9-aeb62bf4229b None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:25.415242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718e2a1-3e05-4c88-86e9-aeb62bf4229b None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:25.415517 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718e2a1-3e05-4c88-86e9-aeb62bf4229b None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:25.416264 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718e2a1-3e05-4c88-86e9-aeb62bf4229b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:25.416570 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718e2a1-3e05-4c88-86e9-aeb62bf4229b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:25.417957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718e2a1-3e05-4c88-86e9-aeb62bf4229b None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:25.429058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 263/514] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:25.429924 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718e2a1-3e05-4c88-86e9-aeb62bf4229b None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:25.441642 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb75af-4a19-48b7-ba11-03ba2fcc2588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:25.442306 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb75af-4a19-48b7-ba11-03ba2fcc2588 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:25.442587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb75af-4a19-48b7-ba11-03ba2fcc2588 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:25.442861 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb75af-4a19-48b7-ba11-03ba2fcc2588 None admin] PATH_INFO: `/v3/users` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:25.443731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb75af-4a19-48b7-ba11-03ba2fcc2588 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:25.444040 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb75af-4a19-48b7-ba11-03ba2fcc2588 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:25.445478 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb75af-4a19-48b7-ba11-03ba2fcc2588 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:25.462433 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 252/515] 10.222.0.64 () {56 vars in 1139 bytes} [Thu May 12 16:53:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:25.463221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb75af-4a19-48b7-ba11-03ba2fcc2588 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:25.522831 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718e2a1-3e05-4c88-86e9-aeb62bf4229b None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:25.555828 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f2ab5-2922-45a3-b6e8-ab49ba41ab6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:25.556481 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f2ab5-2922-45a3-b6e8-ab49ba41ab6b None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:25.556758 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f2ab5-2922-45a3-b6e8-ab49ba41ab6b None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:25.556850 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb75af-4a19-48b7-ba11-03ba2fcc2588 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:25.557268 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f2ab5-2922-45a3-b6e8-ab49ba41ab6b None admin] PATH_INFO: `/v3/projects` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:25.557788 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f2ab5-2922-45a3-b6e8-ab49ba41ab6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:25.558092 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f2ab5-2922-45a3-b6e8-ab49ba41ab6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:25.559537 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f2ab5-2922-45a3-b6e8-ab49ba41ab6b None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:25.576801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 264/516] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:53:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:25.577597 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f2ab5-2922-45a3-b6e8-ab49ba41ab6b None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:25.589767 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e17bd-6834-40bc-88f3-15fb9de6e5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:25.590544 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e17bd-6834-40bc-88f3-15fb9de6e5a9 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:25.590819 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e17bd-6834-40bc-88f3-15fb9de6e5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:25.591088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e17bd-6834-40bc-88f3-15fb9de6e5a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:25.601344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e17bd-6834-40bc-88f3-15fb9de6e5a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:25.602773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e17bd-6834-40bc-88f3-15fb9de6e5a9 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:25.619964 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-019e17bd-6834-40bc-88f3-15fb9de6e5a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:25.619964 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:25.619964 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:25.619964 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:25.619964 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:25.619964 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:25.619964 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:25.619964 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:25.619964 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:25.619964 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:25.619964 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:25.619964 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:25.619964 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:25.619964 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:25.619964 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:25.620813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:25.620813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:25.620813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:25.620813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:25.620813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:25.620813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:25.620813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:25.620813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:25.620813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:25.620813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:25.620813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:25.620813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:25.620813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:25.620813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:25.620813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:25.620813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:25.620813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:25.621658 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:25.621658 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:25.621658 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:25.621658 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:25.621658 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 253/517] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:25.621928 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e17bd-6834-40bc-88f3-15fb9de6e5a9 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:25.669500 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f2ab5-2922-45a3-b6e8-ab49ba41ab6b None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:25.702477 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6baad-967b-4131-a059-53d75c34bb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:25.703252 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6baad-967b-4131-a059-53d75c34bb9e None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:25.703530 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6baad-967b-4131-a059-53d75c34bb9e None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:25.703837 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6baad-967b-4131-a059-53d75c34bb9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:25.710179 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6baad-967b-4131-a059-53d75c34bb9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:25.711618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6baad-967b-4131-a059-53d75c34bb9e None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:25.718314 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e17bd-6834-40bc-88f3-15fb9de6e5a9 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:25.725617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-f8a6baad-967b-4131-a059-53d75c34bb9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:25.725617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:25.725617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:25.725617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:25.725617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:25.725617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:25.725617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:25.725617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:25.725617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:25.725617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:25.725617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:25.725617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:25.725617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:53:25.725617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:53:25.725617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:53:25.726827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:53:25.726827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:25.726827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:25.726827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:25.726827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:25.726827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:25.726827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:25.726827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:25.726827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:25.726827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:25.726827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:25.726827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:25.726827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:25.726827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:25.726827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:25.726827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:25.726827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:25.727958 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:53:25.727958 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:53:25.727958 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:53:25.727958 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:53:25.727958 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:53:25.727958 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:53:25.727958 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:25.727958 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:25.731717 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 265/518] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:25.732410 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6baad-967b-4131-a059-53d75c34bb9e None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:25.750936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d886d-ac02-4916-b233-1b7b4fa9fb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:25.751572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d886d-ac02-4916-b233-1b7b4fa9fb61 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:25.751874 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d886d-ac02-4916-b233-1b7b4fa9fb61 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:25.752147 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d886d-ac02-4916-b233-1b7b4fa9fb61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:25.815720 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d886d-ac02-4916-b233-1b7b4fa9fb61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:25.817115 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d886d-ac02-4916-b233-1b7b4fa9fb61 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:25.825447 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6baad-967b-4131-a059-53d75c34bb9e None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:25.858521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca9c7a-a122-404e-a304-7566cc55475c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:25.859164 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca9c7a-a122-404e-a304-7566cc55475c None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:25.859448 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca9c7a-a122-404e-a304-7566cc55475c None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:25.859755 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca9c7a-a122-404e-a304-7566cc55475c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:25.860579 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca9c7a-a122-404e-a304-7566cc55475c None admin] RBAC: Adding query filter params (role.id=0f1a9958b7874b10b41712760f0b6ffa, scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff, user.id=cd52d2543a9f4b5d9270a12544b0a021) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:25.860890 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca9c7a-a122-404e-a304-7566cc55475c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:25.862322 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca9c7a-a122-404e-a304-7566cc55475c None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:25.867552 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 266/519] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:53:25 2022] GET /identity/v3/role_assignments?user.id=cd52d2543a9f4b5d9270a12544b0a021&scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff&role.id=0f1a9958b7874b10b41712760f0b6ffa => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:25.868361 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca9c7a-a122-404e-a304-7566cc55475c None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:25.920048 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 254/520] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:53:25.920048 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d886d-ac02-4916-b233-1b7b4fa9fb61 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:25.983484 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca9c7a-a122-404e-a304-7566cc55475c None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:26.018111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab330d-0933-4a27-af11-3572978037a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:26.018468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d886d-ac02-4916-b233-1b7b4fa9fb61 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:26.018788 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab330d-0933-4a27-af11-3572978037a4 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:26.019065 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab330d-0933-4a27-af11-3572978037a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:26.019338 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab330d-0933-4a27-af11-3572978037a4 None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:26.020108 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab330d-0933-4a27-af11-3572978037a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:26.020411 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab330d-0933-4a27-af11-3572978037a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:26.021867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab330d-0933-4a27-af11-3572978037a4 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:26.039358 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 267/521] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:26.039358 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab330d-0933-4a27-af11-3572978037a4 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:26.063160 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be4cec-6bde-4611-ae49-ef16344b8b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:26.063954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be4cec-6bde-4611-ae49-ef16344b8b79 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:26.064240 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be4cec-6bde-4611-ae49-ef16344b8b79 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:26.064515 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be4cec-6bde-4611-ae49-ef16344b8b79 None admin] PATH_INFO: `/v3/projects` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:26.065299 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be4cec-6bde-4611-ae49-ef16344b8b79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:26.065606 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be4cec-6bde-4611-ae49-ef16344b8b79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:26.067112 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be4cec-6bde-4611-ae49-ef16344b8b79 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:26.084705 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 255/522] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:53:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:26.085536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be4cec-6bde-4611-ae49-ef16344b8b79 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:26.142944 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab330d-0933-4a27-af11-3572978037a4 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:26.176289 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552c634-88b1-4ec0-93bf-007e7dd6f7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:26.177078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552c634-88b1-4ec0-93bf-007e7dd6f7b7 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:26.177359 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552c634-88b1-4ec0-93bf-007e7dd6f7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:26.177630 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552c634-88b1-4ec0-93bf-007e7dd6f7b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:26.181345 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be4cec-6bde-4611-ae49-ef16344b8b79 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:26.190610 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552c634-88b1-4ec0-93bf-007e7dd6f7b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:26.192168 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552c634-88b1-4ec0-93bf-007e7dd6f7b7 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:26.215520 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-a552c634-88b1-4ec0-93bf-007e7dd6f7b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:26.215520 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:26.215520 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:26.215520 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:26.215520 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:26.215520 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:26.215520 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:26.215520 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:26.215520 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:26.215520 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:26.215520 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:26.215520 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:26.215520 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:26.215520 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:26.215520 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:26.216632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:26.216632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:26.216632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:26.216632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:26.216632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:26.216632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:26.216632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:26.216632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:26.216632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:26.216632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:26.216632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:26.216632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:26.216632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:26.216632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:26.216632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:26.216632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:26.216632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:26.218274 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:26.218274 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:26.218274 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:26.218274 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:26.218519 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf6a13-a8d2-4047-8676-eda8e57bd081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:26.218519 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf6a13-a8d2-4047-8676-eda8e57bd081 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:26.218519 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf6a13-a8d2-4047-8676-eda8e57bd081 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:26.218519 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf6a13-a8d2-4047-8676-eda8e57bd081 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:26.220174 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 268/523] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:26.221124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552c634-88b1-4ec0-93bf-007e7dd6f7b7 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:26.229515 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf6a13-a8d2-4047-8676-eda8e57bd081 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:26.231146 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf6a13-a8d2-4047-8676-eda8e57bd081 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:26.245887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-1fdf6a13-a8d2-4047-8676-eda8e57bd081 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:26.245887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:26.245887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:26.245887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:26.245887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:26.245887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:26.245887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:26.245887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:26.245887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:26.245887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:26.245887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:26.245887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:26.245887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:53:26.245887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:53:26.245887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:53:26.246940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:53:26.246940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:26.246940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:26.246940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:26.246940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:26.246940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:26.246940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:26.246940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:26.246940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:26.246940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:26.246940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:26.246940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:26.246940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:26.246940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:26.246940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:26.246940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:26.246940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:26.248060 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:53:26.248060 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:53:26.248060 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:53:26.248060 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:53:26.248060 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:53:26.248060 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:53:26.248060 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:26.248060 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:26.249883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 256/524] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:26.250803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf6a13-a8d2-4047-8676-eda8e57bd081 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:26.322952 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552c634-88b1-4ec0-93bf-007e7dd6f7b7 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:26.351718 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf6a13-a8d2-4047-8676-eda8e57bd081 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:26.357420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3dacd-2592-486a-9787-1d1abcd526c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:26.358118 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3dacd-2592-486a-9787-1d1abcd526c2 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:26.358403 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3dacd-2592-486a-9787-1d1abcd526c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:26.358685 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3dacd-2592-486a-9787-1d1abcd526c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:26.359511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3dacd-2592-486a-9787-1d1abcd526c2 None admin] RBAC: Adding query filter params (role.id=0f1a9958b7874b10b41712760f0b6ffa, scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff, user.id=deb66d4bda564438852a38a4a4116ccb) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:26.359862 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3dacd-2592-486a-9787-1d1abcd526c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:26.361314 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3dacd-2592-486a-9787-1d1abcd526c2 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:26.367652 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 269/525] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:53:26 2022] GET /identity/v3/role_assignments?user.id=deb66d4bda564438852a38a4a4116ccb&scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff&role.id=0f1a9958b7874b10b41712760f0b6ffa => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:26.368020 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3dacd-2592-486a-9787-1d1abcd526c2 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:26.386943 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ed509-ab2f-48e6-adf6-96061fa315a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:26.387706 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ed509-ab2f-48e6-adf6-96061fa315a7 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:26.387988 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ed509-ab2f-48e6-adf6-96061fa315a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:26.388258 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ed509-ab2f-48e6-adf6-96061fa315a7 None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:26.389550 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ed509-ab2f-48e6-adf6-96061fa315a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:26.389970 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ed509-ab2f-48e6-adf6-96061fa315a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:26.391413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ed509-ab2f-48e6-adf6-96061fa315a7 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:26.405731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 257/526] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:26.411758 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ed509-ab2f-48e6-adf6-96061fa315a7 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:26.484624 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3dacd-2592-486a-9787-1d1abcd526c2 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:26.520381 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ed509-ab2f-48e6-adf6-96061fa315a7 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:26.521219 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b8b77-9d8f-46b9-b003-858ae7ba16b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:26.522043 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b8b77-9d8f-46b9-b003-858ae7ba16b4 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:26.522329 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b8b77-9d8f-46b9-b003-858ae7ba16b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:26.522607 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b8b77-9d8f-46b9-b003-858ae7ba16b4 None admin] PATH_INFO: `/v3/projects` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:26.523412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b8b77-9d8f-46b9-b003-858ae7ba16b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:26.523991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b8b77-9d8f-46b9-b003-858ae7ba16b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:26.525772 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b8b77-9d8f-46b9-b003-858ae7ba16b4 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:26.538955 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 270/527] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:53:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:26.544719 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b8b77-9d8f-46b9-b003-858ae7ba16b4 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:26.563404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc5883-6045-472f-b271-900af3d19aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:26.564309 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc5883-6045-472f-b271-900af3d19aaf None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:26.564513 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc5883-6045-472f-b271-900af3d19aaf None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:26.564801 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc5883-6045-472f-b271-900af3d19aaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:26.571954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc5883-6045-472f-b271-900af3d19aaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:26.573625 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc5883-6045-472f-b271-900af3d19aaf None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:26.587427 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-d4fc5883-6045-472f-b271-900af3d19aaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:26.587427 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:26.587427 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:26.587427 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:26.587427 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:26.587427 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:26.587427 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:26.587427 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:26.587427 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:26.587427 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:26.587427 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:26.587427 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:26.587427 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:53:26.587427 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:53:26.587427 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:53:26.588342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:53:26.588342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:26.588342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:26.588342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:26.588342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:26.588342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:26.588342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:26.588342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:26.588342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:26.588342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:26.588342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:26.588342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:26.588342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:26.588342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:26.588342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:26.588342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:26.588342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:26.589193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:53:26.589193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:53:26.589193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:53:26.589193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:53:26.589193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:53:26.589193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:53:26.589193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:26.589193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:26.589193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 258/528] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:26.595264 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc5883-6045-472f-b271-900af3d19aaf None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:26.655499 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b8b77-9d8f-46b9-b003-858ae7ba16b4 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:26.691183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0c7cc-6dc5-4907-8dec-b302035ca563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:26.692058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0c7cc-6dc5-4907-8dec-b302035ca563 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:26.692361 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0c7cc-6dc5-4907-8dec-b302035ca563 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:26.692747 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0c7cc-6dc5-4907-8dec-b302035ca563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:26.693587 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0c7cc-6dc5-4907-8dec-b302035ca563 None admin] RBAC: Adding query filter params (role.id=0f1a9958b7874b10b41712760f0b6ffa, scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff, user.id=83541095ea5646038feef0764f0473c0) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:26.693901 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0c7cc-6dc5-4907-8dec-b302035ca563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:26.695484 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0c7cc-6dc5-4907-8dec-b302035ca563 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:26.699550 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc5883-6045-472f-b271-900af3d19aaf None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:26.707674 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 271/529] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:53:26 2022] GET /identity/v3/role_assignments?user.id=83541095ea5646038feef0764f0473c0&scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff&role.id=0f1a9958b7874b10b41712760f0b6ffa => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:26.739957 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20cad5-56c5-4cac-82c5-c7828d4ff8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:26.740640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20cad5-56c5-4cac-82c5-c7828d4ff8f3 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:26.740933 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20cad5-56c5-4cac-82c5-c7828d4ff8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:26.741213 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20cad5-56c5-4cac-82c5-c7828d4ff8f3 None admin] PATH_INFO: `/v3/projects` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:26.742018 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20cad5-56c5-4cac-82c5-c7828d4ff8f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:26.742331 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20cad5-56c5-4cac-82c5-c7828d4ff8f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:26.743878 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20cad5-56c5-4cac-82c5-c7828d4ff8f3 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:26.758288 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 259/530] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:53:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:26.764137 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0c7cc-6dc5-4907-8dec-b302035ca563 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:26.873497 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0c7cc-6dc5-4907-8dec-b302035ca563 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:26.914069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e1aea-e64a-45b6-bb97-ca9a31c659fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:26.914069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e1aea-e64a-45b6-bb97-ca9a31c659fe None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:26.914475 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e1aea-e64a-45b6-bb97-ca9a31c659fe None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:26.914650 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e1aea-e64a-45b6-bb97-ca9a31c659fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:26.915481 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e1aea-e64a-45b6-bb97-ca9a31c659fe None admin] RBAC: Adding query filter params (role.id=0f1a9958b7874b10b41712760f0b6ffa, scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff, user.id=b2cc0957b3e2402b8e6f47d46bfa02be) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:26.915836 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e1aea-e64a-45b6-bb97-ca9a31c659fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:26.917318 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e1aea-e64a-45b6-bb97-ca9a31c659fe None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:26.930366 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 272/531] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:53:26 2022] GET /identity/v3/role_assignments?user.id=b2cc0957b3e2402b8e6f47d46bfa02be&scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff&role.id=0f1a9958b7874b10b41712760f0b6ffa => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:28.192630 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fb5eb-a887-4404-a6ef-798c1a598743 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:28.193133 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fb5eb-a887-4404-a6ef-798c1a598743 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:28.193133 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fb5eb-a887-4404-a6ef-798c1a598743 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:28.194807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 260/532] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:28.200183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f8c13-063a-46e9-bd7b-4aa7b5236ac7 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:28.200566 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f8c13-063a-46e9-bd7b-4aa7b5236ac7 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:28.200743 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f8c13-063a-46e9-bd7b-4aa7b5236ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:28.218075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-083f8c13-063a-46e9-bd7b-4aa7b5236ac7 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:28.219241 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-083f8c13-063a-46e9-bd7b-4aa7b5236ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:28.293727 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 273/533] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:28.314656 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fb5eb-a887-4404-a6ef-798c1a598743 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:28.413798 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fb5eb-a887-4404-a6ef-798c1a598743 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:28.447512 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07e099-3e03-4ac9-8f9f-d71654d37d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:28.448272 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07e099-3e03-4ac9-8f9f-d71654d37d8c None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:28.448548 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07e099-3e03-4ac9-8f9f-d71654d37d8c None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:28.448816 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07e099-3e03-4ac9-8f9f-d71654d37d8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:28.459367 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07e099-3e03-4ac9-8f9f-d71654d37d8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:28.467017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-6c07e099-3e03-4ac9-8f9f-d71654d37d8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:28.467017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:28.467017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:28.467017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:28.467017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:28.467017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:28.467017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:28.467017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:28.467017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:28.467017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:28.467017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:28.467017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:28.467017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:28.467017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:28.467017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:28.467017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:28.467895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:28.467895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:28.467895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:28.467895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:28.467895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:28.467895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:28.467895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:28.467895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:28.467895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:28.467895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:28.467895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:28.467895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:28.467895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:28.467895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:28.467895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:28.467895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:28.468698 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:28.468698 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:28.468698 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:28.468698 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:28.468698 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:28.468698 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:28.468698 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:28.468698 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:28.468698 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:28.468698 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:28.468698 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:28.468698 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:28.472961 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 261/534] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 12 16:53:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:28.474308 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f8c13-063a-46e9-bd7b-4aa7b5236ac7 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:28.579372 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f8c13-063a-46e9-bd7b-4aa7b5236ac7 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:28.614901 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05368377-1b66-43f8-a2b5-61942a000f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:28.615561 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05368377-1b66-43f8-a2b5-61942a000f99 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:28.615873 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05368377-1b66-43f8-a2b5-61942a000f99 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:28.616144 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05368377-1b66-43f8-a2b5-61942a000f99 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:28.616891 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05368377-1b66-43f8-a2b5-61942a000f99 None admin] RBAC: Adding query filter params (name=service) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:28.617188 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05368377-1b66-43f8-a2b5-61942a000f99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:28.618574 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05368377-1b66-43f8-a2b5-61942a000f99 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:28.631137 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 274/535] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 12 16:53:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:28.632511 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07e099-3e03-4ac9-8f9f-d71654d37d8c None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:28.700748 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c402b75-b571-4323-aecd-ef510a24ca99 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:28.701042 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c402b75-b571-4323-aecd-ef510a24ca99 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:28.701219 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c402b75-b571-4323-aecd-ef510a24ca99 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:28.703368 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 275/536] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:28.708583 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc8744-80a9-437e-b1db-f5c66f01cf0e None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:28.708869 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc8744-80a9-437e-b1db-f5c66f01cf0e None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:28.709153 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc8744-80a9-437e-b1db-f5c66f01cf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:28.726343 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-93dc8744-80a9-437e-b1db-f5c66f01cf0e None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:28.727533 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-93dc8744-80a9-437e-b1db-f5c66f01cf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:28.738235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07e099-3e03-4ac9-8f9f-d71654d37d8c None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:28.787983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6c70a-81b5-4de7-821f-89179fe59f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:28.788892 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6c70a-81b5-4de7-821f-89179fe59f3a None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:28.789176 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6c70a-81b5-4de7-821f-89179fe59f3a None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:28.789605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6c70a-81b5-4de7-821f-89179fe59f3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:28.801889 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6c70a-81b5-4de7-821f-89179fe59f3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:28.803354 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6c70a-81b5-4de7-821f-89179fe59f3a None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:28.803906 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 276/537] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:28.821553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-b7f6c70a-81b5-4de7-821f-89179fe59f3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:28.821553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:28.821553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:28.821553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:28.821553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:28.821553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:28.821553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:28.821553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:28.821553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:28.821553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:28.821553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:28.821553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:28.821553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:28.821553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:28.821553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:28.823615 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:28.823615 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:28.823615 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:28.823615 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:28.823615 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:28.823615 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:28.823615 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:28.823615 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:28.823615 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:28.823615 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:28.823615 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:28.823615 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:28.823615 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:28.823615 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:28.823615 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:28.823615 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:28.823615 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:28.824871 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:28.824871 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:28.824871 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:28.824871 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:28.825193 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc8744-80a9-437e-b1db-f5c66f01cf0e None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:28.827493 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 262/538] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:28.829626 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6c70a-81b5-4de7-821f-89179fe59f3a None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:28.938120 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc8744-80a9-437e-b1db-f5c66f01cf0e None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:28.963679 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6c70a-81b5-4de7-821f-89179fe59f3a None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:28.982277 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328137be-669e-4deb-8f9f-25e057d9b2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:28.983890 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328137be-669e-4deb-8f9f-25e057d9b2b5 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:28.984628 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328137be-669e-4deb-8f9f-25e057d9b2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:28.985099 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328137be-669e-4deb-8f9f-25e057d9b2b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:28.996863 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69584a-c466-472b-9f9b-bb03183f2904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:28.997533 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69584a-c466-472b-9f9b-bb03183f2904 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:28.997816 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69584a-c466-472b-9f9b-bb03183f2904 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:28.998101 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69584a-c466-472b-9f9b-bb03183f2904 None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:28.999358 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69584a-c466-472b-9f9b-bb03183f2904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:28.999686 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69584a-c466-472b-9f9b-bb03183f2904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:29.000170 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328137be-669e-4deb-8f9f-25e057d9b2b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:29.001078 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69584a-c466-472b-9f9b-bb03183f2904 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:29.009419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-328137be-669e-4deb-8f9f-25e057d9b2b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:29.009419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:29.009419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:29.009419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:29.009419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:29.009419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:29.009419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:29.009419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:29.009419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:29.009419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:29.009419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:29.009419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:29.009419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:29.009419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:29.009419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:29.009419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:29.010285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:29.010285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:29.010285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:29.010285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:29.010285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:29.010285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:29.010285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:29.010285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:29.010285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:29.010285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:29.010285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:29.010285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:29.010285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:29.010285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:29.010285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:29.010285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:29.011055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:29.011055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:29.011055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:29.011055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:29.011055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:29.011055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:29.011055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:29.011055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:29.011055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:29.011055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:29.011055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:29.011055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:29.014607 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 277/539] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 12 16:53:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:53:29.020240 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328137be-669e-4deb-8f9f-25e057d9b2b5 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:29.020563 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 263/540] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:29.025851 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69584a-c466-472b-9f9b-bb03183f2904 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:29.127997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328137be-669e-4deb-8f9f-25e057d9b2b5 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:29.131923 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69584a-c466-472b-9f9b-bb03183f2904 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:29.161339 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25cbd7-67f4-4d5e-9434-9e589a7b8e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:29.162001 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25cbd7-67f4-4d5e-9434-9e589a7b8e16 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:29.162284 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25cbd7-67f4-4d5e-9434-9e589a7b8e16 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:29.162571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25cbd7-67f4-4d5e-9434-9e589a7b8e16 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:29.163313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25cbd7-67f4-4d5e-9434-9e589a7b8e16 None admin] RBAC: Adding query filter params (name=service) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:29.163617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25cbd7-67f4-4d5e-9434-9e589a7b8e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:29.165035 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25cbd7-67f4-4d5e-9434-9e589a7b8e16 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:29.168245 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f47dd4-fb34-4847-b058-e915ff9bc305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:29.169226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f47dd4-fb34-4847-b058-e915ff9bc305 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:29.170634 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f47dd4-fb34-4847-b058-e915ff9bc305 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:29.171094 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f47dd4-fb34-4847-b058-e915ff9bc305 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:29.173694 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 278/541] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 12 16:53:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:29.175020 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea14a9-bc51-44f5-aadb-6407d7706232 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:29.175315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea14a9-bc51-44f5-aadb-6407d7706232 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:29.175594 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea14a9-bc51-44f5-aadb-6407d7706232 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:29.178573 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 279/542] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:29.178897 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea14a9-bc51-44f5-aadb-6407d7706232 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:29.183608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f47dd4-fb34-4847-b058-e915ff9bc305 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:29.185102 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f47dd4-fb34-4847-b058-e915ff9bc305 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:29.199557 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-83f47dd4-fb34-4847-b058-e915ff9bc305 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 16:53:29.199557 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:29.199557 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:29.199557 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:29.199557 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:29.199557 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:29.199557 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:29.199557 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:29.199557 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:29.199557 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:29.199557 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:29.199557 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:29.199557 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:53:29.199557 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:53:29.199557 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:53:29.199557 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:53:29.200906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:29.200906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:29.200906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:53:29.200906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:29.200906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:53:29.200906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:29.200906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:29.200906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:29.200906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:29.200906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:29.200906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:29.200906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:29.200906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:29.200906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:29.200906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:29.200906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:29.200906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:29.200906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:29.202316 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:29.202316 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:29.202316 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:53:29.202316 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:53:29.202316 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:53:29.202316 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:53:29.202316 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:53:29.202316 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:53:29.202316 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 16:53:29.202316 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:29.203941 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 264/543] 10.222.0.64 () {56 vars in 1093 bytes} [Thu May 12 16:53:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:29.205404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917d2f-2b25-4fe7-8796-ccaab1606bea None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:29.205886 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917d2f-2b25-4fe7-8796-ccaab1606bea None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:29.206387 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917d2f-2b25-4fe7-8796-ccaab1606bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:29.223089 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-f5917d2f-2b25-4fe7-8796-ccaab1606bea None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:29.224306 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-f5917d2f-2b25-4fe7-8796-ccaab1606bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:29.281458 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea14a9-bc51-44f5-aadb-6407d7706232 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:29.290855 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 265/544] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:29.291719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5917d2f-2b25-4fe7-8796-ccaab1606bea None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:29.315503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e0a72-61aa-48de-9cae-7d9991077e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:29.316337 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e0a72-61aa-48de-9cae-7d9991077e3a None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:29.316620 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e0a72-61aa-48de-9cae-7d9991077e3a None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:29.316895 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e0a72-61aa-48de-9cae-7d9991077e3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:29.327062 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e0a72-61aa-48de-9cae-7d9991077e3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:29.328549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e0a72-61aa-48de-9cae-7d9991077e3a None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:29.344920 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-a04e0a72-61aa-48de-9cae-7d9991077e3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:29.344920 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:29.344920 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:29.344920 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:29.344920 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:29.344920 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:29.344920 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:29.344920 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:29.344920 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:29.344920 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:29.344920 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:29.344920 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:29.344920 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:29.344920 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:29.344920 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:29.345840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:29.345840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:29.345840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:29.345840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:29.345840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:29.345840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:29.345840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:29.345840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:29.345840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:29.345840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:29.345840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:29.345840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:29.345840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:29.345840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:29.345840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:29.345840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:29.345840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:29.346699 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:29.346699 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:29.346699 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:29.346699 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:29.346699 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 280/545] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:29.347285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eba718-4965-4ab0-8a88-71b1522f530e None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:29.347569 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eba718-4965-4ab0-8a88-71b1522f530e None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:29.347871 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eba718-4965-4ab0-8a88-71b1522f530e None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:29.349122 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 281/546] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:29.349827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eba718-4965-4ab0-8a88-71b1522f530e None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:29.389355 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5917d2f-2b25-4fe7-8796-ccaab1606bea None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:29.421310 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65f2b6-8c5b-48af-a167-b995cebd4dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:29.421970 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65f2b6-8c5b-48af-a167-b995cebd4dac None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:29.422251 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65f2b6-8c5b-48af-a167-b995cebd4dac None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:29.422530 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65f2b6-8c5b-48af-a167-b995cebd4dac None admin] PATH_INFO: `/v3/users` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:29.423359 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65f2b6-8c5b-48af-a167-b995cebd4dac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:29.423693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65f2b6-8c5b-48af-a167-b995cebd4dac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:29.425139 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65f2b6-8c5b-48af-a167-b995cebd4dac None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:29.441337 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 266/547] 10.222.0.64 () {56 vars in 1133 bytes} [Thu May 12 16:53:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:29.442128 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65f2b6-8c5b-48af-a167-b995cebd4dac None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:29.445886 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eba718-4965-4ab0-8a88-71b1522f530e None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:29.478734 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cba129-6e60-4f92-8bd2-4518438df16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:29.479451 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cba129-6e60-4f92-8bd2-4518438df16b None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:29.479757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cba129-6e60-4f92-8bd2-4518438df16b None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:29.480028 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cba129-6e60-4f92-8bd2-4518438df16b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:29.489581 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cba129-6e60-4f92-8bd2-4518438df16b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:29.497224 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-52cba129-6e60-4f92-8bd2-4518438df16b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:29.497224 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:29.497224 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:29.497224 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:29.497224 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:29.497224 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:29.497224 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:29.497224 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:29.497224 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:29.497224 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:29.497224 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:29.497224 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:29.497224 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:29.497224 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:29.497224 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:29.497224 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:29.498111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:29.498111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:29.498111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:29.498111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:29.498111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:29.498111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:29.498111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:29.498111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:29.498111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:29.498111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:29.498111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:29.498111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:29.498111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:29.498111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:29.498111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:29.498111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:29.499420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:29.499420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:29.499420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:29.499420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:29.499420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:29.499420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:29.499420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:29.499420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:29.499420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:29.499420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:29.499420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:29.499420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:29.499420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 282/548] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 12 16:53:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:29.500146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3da4a-00e1-4c14-b93a-3641be5343da None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:29.500482 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3da4a-00e1-4c14-b93a-3641be5343da None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:29.500791 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3da4a-00e1-4c14-b93a-3641be5343da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:29.516521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-aec3da4a-00e1-4c14-b93a-3641be5343da None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:29.517710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-aec3da4a-00e1-4c14-b93a-3641be5343da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:29.541458 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65f2b6-8c5b-48af-a167-b995cebd4dac None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:29.579502 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98698cb-7cb0-42ad-89a6-207480a24d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:29.580196 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98698cb-7cb0-42ad-89a6-207480a24d71 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:29.580480 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98698cb-7cb0-42ad-89a6-207480a24d71 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:29.580758 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98698cb-7cb0-42ad-89a6-207480a24d71 None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:29.581488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98698cb-7cb0-42ad-89a6-207480a24d71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:29.581797 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98698cb-7cb0-42ad-89a6-207480a24d71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:29.583265 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98698cb-7cb0-42ad-89a6-207480a24d71 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:29.589093 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 283/549] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:29.589945 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3da4a-00e1-4c14-b93a-3641be5343da None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:29.594482 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 267/550] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:29.595150 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98698cb-7cb0-42ad-89a6-207480a24d71 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:29.683899 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3da4a-00e1-4c14-b93a-3641be5343da None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:29.690674 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98698cb-7cb0-42ad-89a6-207480a24d71 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:29.716202 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2660d-9c40-4558-a8d0-756bff9e3aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:29.716986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2660d-9c40-4558-a8d0-756bff9e3aee None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:29.717266 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2660d-9c40-4558-a8d0-756bff9e3aee None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:29.717539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2660d-9c40-4558-a8d0-756bff9e3aee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:29.721980 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939a6fd-70b1-456f-8e24-b02b20452e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:29.722643 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939a6fd-70b1-456f-8e24-b02b20452e74 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:29.723021 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939a6fd-70b1-456f-8e24-b02b20452e74 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:29.723297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939a6fd-70b1-456f-8e24-b02b20452e74 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:29.724071 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939a6fd-70b1-456f-8e24-b02b20452e74 None admin] RBAC: Adding query filter params (name=service) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:29.724376 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939a6fd-70b1-456f-8e24-b02b20452e74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:29.725733 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939a6fd-70b1-456f-8e24-b02b20452e74 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:29.727229 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2660d-9c40-4558-a8d0-756bff9e3aee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:29.728695 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2660d-9c40-4558-a8d0-756bff9e3aee None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:29.733595 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 268/551] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 12 16:53:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:29.734321 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939a6fd-70b1-456f-8e24-b02b20452e74 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:29.749408 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-4ad2660d-9c40-4558-a8d0-756bff9e3aee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:29.749408 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:29.749408 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:29.749408 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:29.749408 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:29.749408 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:29.749408 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:29.749408 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:29.749408 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:29.749408 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:29.749408 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:29.749408 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:29.749408 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:29.749408 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:29.749408 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:29.750382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:29.750382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:29.750382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:29.750382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:29.750382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:29.750382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:29.750382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:29.750382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:29.750382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:29.750382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:29.750382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:29.750382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:29.750382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:29.750382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:29.750382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:29.750382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:29.750382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:29.751191 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:29.751191 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:29.751191 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:29.751191 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:29.751191 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 284/552] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:29.751444 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2660d-9c40-4558-a8d0-756bff9e3aee None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:29.833916 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939a6fd-70b1-456f-8e24-b02b20452e74 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:29.844023 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2660d-9c40-4558-a8d0-756bff9e3aee None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:29.866433 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db3ad7-7807-4ea8-b45f-95725a8c342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:29.867217 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db3ad7-7807-4ea8-b45f-95725a8c342f None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:29.867498 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db3ad7-7807-4ea8-b45f-95725a8c342f None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:29.867797 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db3ad7-7807-4ea8-b45f-95725a8c342f None admin] PATH_INFO: `/v3/users/glance` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:29.875015 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db3ad7-7807-4ea8-b45f-95725a8c342f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:29.875936 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b14c92-62fa-4cec-a3e1-2ca2bd72c80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:29.876514 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db3ad7-7807-4ea8-b45f-95725a8c342f None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:29.876715 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b14c92-62fa-4cec-a3e1-2ca2bd72c80c None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:29.876996 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b14c92-62fa-4cec-a3e1-2ca2bd72c80c None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:29.877268 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b14c92-62fa-4cec-a3e1-2ca2bd72c80c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:29.886889 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b14c92-62fa-4cec-a3e1-2ca2bd72c80c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:29.890840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-22db3ad7-7807-4ea8-b45f-95725a8c342f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 16:53:29.890840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:29.890840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:29.890840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:29.890840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:29.890840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:29.890840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:29.890840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:29.890840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:29.890840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:29.890840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:29.890840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:29.890840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:53:29.890840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:53:29.890840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:53:29.890840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:53:29.891765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:29.891765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:29.891765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:53:29.891765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:29.891765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:53:29.891765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:29.891765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:29.891765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:29.891765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:29.891765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:29.891765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:29.891765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:29.891765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:29.891765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:29.891765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:29.891765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:29.891765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:29.891765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:29.892658 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:29.892658 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:29.892658 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:53:29.892658 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:53:29.892658 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:53:29.892658 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:53:29.892658 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:53:29.892658 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:53:29.892658 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 16:53:29.892658 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:29.892658 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 269/553] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:53:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:29.893222 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db3ad7-7807-4ea8-b45f-95725a8c342f None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:29.895124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-a1b14c92-62fa-4cec-a3e1-2ca2bd72c80c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:29.895124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:29.895124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:29.895124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:29.895124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:29.895124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:29.895124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:29.895124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:29.895124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:29.895124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:29.895124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:29.895124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:29.895124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:29.895124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:29.895124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:29.895124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:29.896152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:29.896152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:29.896152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:29.896152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:29.896152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:29.896152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:29.896152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:29.896152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:29.896152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:29.896152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:29.896152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:29.896152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:29.896152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:29.896152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:29.896152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:29.896152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:29.898355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:29.898355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:29.898355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:29.898355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:29.898355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:29.898355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:29.898355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:29.898355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:29.898355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:29.898355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:29.898355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:29.898355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:29.898355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 285/554] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 12 16:53:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:29.898355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b14c92-62fa-4cec-a3e1-2ca2bd72c80c None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:29.992430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b14c92-62fa-4cec-a3e1-2ca2bd72c80c None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:29.999070 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db3ad7-7807-4ea8-b45f-95725a8c342f None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:30.023785 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee221ccd-d3c1-4c68-afae-0b29e7a51e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:30.024446 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee221ccd-d3c1-4c68-afae-0b29e7a51e6f None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:30.024728 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee221ccd-d3c1-4c68-afae-0b29e7a51e6f None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:30.025055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee221ccd-d3c1-4c68-afae-0b29e7a51e6f None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:30.025776 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee221ccd-d3c1-4c68-afae-0b29e7a51e6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:30.026102 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee221ccd-d3c1-4c68-afae-0b29e7a51e6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:30.027470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee221ccd-d3c1-4c68-afae-0b29e7a51e6f None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:30.032021 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d592342-34cb-498c-9abd-0778ac9cd6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:30.032798 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d592342-34cb-498c-9abd-0778ac9cd6f1 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:30.033078 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d592342-34cb-498c-9abd-0778ac9cd6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:30.033353 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d592342-34cb-498c-9abd-0778ac9cd6f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:30.041961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 286/555] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:30.042796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee221ccd-d3c1-4c68-afae-0b29e7a51e6f None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:30.043658 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d592342-34cb-498c-9abd-0778ac9cd6f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:30.045212 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d592342-34cb-498c-9abd-0778ac9cd6f1 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:30.061983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-1d592342-34cb-498c-9abd-0778ac9cd6f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:30.061983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:30.061983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:30.061983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:30.061983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:30.061983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:30.061983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:30.061983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:30.061983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:30.061983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:30.061983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:30.061983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:30.061983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:30.061983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:30.061983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:30.063011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:30.063011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:30.063011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:30.063011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:30.063011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:30.063011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:30.063011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:30.063011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:30.063011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:30.063011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:30.063011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:30.063011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:30.063011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:30.063011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:30.063011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:30.063011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:30.063011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:30.063901 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:30.063901 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:30.063901 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:30.063901 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:30.063901 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 270/556] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:30.064156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d592342-34cb-498c-9abd-0778ac9cd6f1 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:30.140661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee221ccd-d3c1-4c68-afae-0b29e7a51e6f None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:30.156204 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d592342-34cb-498c-9abd-0778ac9cd6f1 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:30.172253 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b38b8-6c6d-425f-8910-4c7f2287a45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:30.172913 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b38b8-6c6d-425f-8910-4c7f2287a45c None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:30.173196 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b38b8-6c6d-425f-8910-4c7f2287a45c None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:30.173474 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b38b8-6c6d-425f-8910-4c7f2287a45c None admin] PATH_INFO: `/v3/users` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:30.174306 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b38b8-6c6d-425f-8910-4c7f2287a45c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:30.174615 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b38b8-6c6d-425f-8910-4c7f2287a45c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:30.176099 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b38b8-6c6d-425f-8910-4c7f2287a45c None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:30.187979 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a5a6f-6464-4c8b-bbdf-5c9941f45bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:30.188633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a5a6f-6464-4c8b-bbdf-5c9941f45bd0 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:30.188918 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a5a6f-6464-4c8b-bbdf-5c9941f45bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:30.189198 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a5a6f-6464-4c8b-bbdf-5c9941f45bd0 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:30.189970 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a5a6f-6464-4c8b-bbdf-5c9941f45bd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:30.190278 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a5a6f-6464-4c8b-bbdf-5c9941f45bd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:30.191653 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a5a6f-6464-4c8b-bbdf-5c9941f45bd0 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:30.192261 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 287/557] 10.222.0.64 () {56 vars in 1137 bytes} [Thu May 12 16:53:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:30.193086 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b38b8-6c6d-425f-8910-4c7f2287a45c None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:30.204721 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 271/558] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 12 16:53:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:30.204721 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a5a6f-6464-4c8b-bbdf-5c9941f45bd0 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:30.290043 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b38b8-6c6d-425f-8910-4c7f2287a45c None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:30.294043 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a5a6f-6464-4c8b-bbdf-5c9941f45bd0 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:30.323237 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41389f-57b5-46b8-915a-b6fb65be7d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:30.324057 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41389f-57b5-46b8-915a-b6fb65be7d06 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:30.324337 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41389f-57b5-46b8-915a-b6fb65be7d06 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:30.324608 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a41389f-57b5-46b8-915a-b6fb65be7d06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:30.327309 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c31df6-6e1b-4230-b7bb-5900c1cc00bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:30.328015 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c31df6-6e1b-4230-b7bb-5900c1cc00bf None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:30.328297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c31df6-6e1b-4230-b7bb-5900c1cc00bf None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:30.328573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c31df6-6e1b-4230-b7bb-5900c1cc00bf None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:30.329286 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c31df6-6e1b-4230-b7bb-5900c1cc00bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:30.329589 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c31df6-6e1b-4230-b7bb-5900c1cc00bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:30.330972 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c31df6-6e1b-4230-b7bb-5900c1cc00bf None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:30.331719 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41389f-57b5-46b8-915a-b6fb65be7d06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:30.333162 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a41389f-57b5-46b8-915a-b6fb65be7d06 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:30.342242 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 272/559] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:30.343032 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c31df6-6e1b-4230-b7bb-5900c1cc00bf None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:30.346957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-9a41389f-57b5-46b8-915a-b6fb65be7d06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:30.346957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:30.346957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:30.346957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:30.346957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:30.346957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:30.346957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:30.346957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:30.346957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:30.346957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:30.346957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:30.346957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:30.346957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:53:30.346957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:53:30.346957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:53:30.347795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:53:30.347795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:30.347795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:30.347795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:30.347795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:30.347795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:30.347795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:30.347795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:30.347795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:30.347795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:30.347795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:30.347795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:30.347795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:30.347795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:30.347795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:30.347795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:30.347795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:30.348713 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:53:30.348713 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:53:30.348713 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:53:30.348713 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:53:30.348713 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:53:30.348713 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:53:30.348713 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:30.348713 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:30.348713 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 288/560] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:30.349162 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41389f-57b5-46b8-915a-b6fb65be7d06 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:30.437705 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c31df6-6e1b-4230-b7bb-5900c1cc00bf None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:30.445301 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a41389f-57b5-46b8-915a-b6fb65be7d06 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:30.470729 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c634a-5c7a-473f-931d-237607f6fac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:30.471518 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c634a-5c7a-473f-931d-237607f6fac3 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:30.471843 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c634a-5c7a-473f-931d-237607f6fac3 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:30.472122 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c634a-5c7a-473f-931d-237607f6fac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:30.476962 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6d90e-d4ca-4194-8602-dd292cb1e4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:30.477738 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6d90e-d4ca-4194-8602-dd292cb1e4b6 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:30.478016 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6d90e-d4ca-4194-8602-dd292cb1e4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:30.478283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6d90e-d4ca-4194-8602-dd292cb1e4b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:30.482049 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c634a-5c7a-473f-931d-237607f6fac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:30.484090 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c634a-5c7a-473f-931d-237607f6fac3 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:30.489826 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6d90e-d4ca-4194-8602-dd292cb1e4b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:30.491355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6d90e-d4ca-4194-8602-dd292cb1e4b6 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:30.500940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-361c634a-5c7a-473f-931d-237607f6fac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:30.500940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:30.500940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:30.500940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:30.500940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:30.500940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:30.500940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:30.500940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:30.500940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:30.500940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:30.500940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:30.500940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:30.500940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:30.500940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:30.500940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:30.501765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:30.501765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:30.501765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:30.501765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:30.501765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:30.501765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:30.501765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:30.501765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:30.501765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:30.501765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:30.501765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:30.501765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:30.501765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:30.501765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:30.501765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:30.501765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:30.501765 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:30.502599 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:30.502599 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:30.502599 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:30.502599 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:30.502599 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 273/561] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:30.503130 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c634a-5c7a-473f-931d-237607f6fac3 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:30.507659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-bef6d90e-d4ca-4194-8602-dd292cb1e4b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:30.507659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:30.507659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:30.507659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:30.507659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:30.507659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:30.507659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:30.507659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:30.507659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:30.507659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:30.507659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:30.507659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:30.507659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:30.507659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:30.507659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:30.508453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:30.508453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:30.508453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:30.508453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:30.508453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:30.508453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:30.508453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:30.508453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:30.508453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:30.508453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:30.508453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:30.508453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:30.508453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:30.508453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:30.508453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:30.508453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:30.508453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:30.509764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:30.509764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:30.509764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:30.509764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:30.509764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 289/562] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:30.510017 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6d90e-d4ca-4194-8602-dd292cb1e4b6 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:30.601383 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c634a-5c7a-473f-931d-237607f6fac3 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:30.603674 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6d90e-d4ca-4194-8602-dd292cb1e4b6 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:30.633172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7cabe-94ff-4966-9ea0-bc64cbd43f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:30.633949 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7cabe-94ff-4966-9ea0-bc64cbd43f04 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:30.634229 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7cabe-94ff-4966-9ea0-bc64cbd43f04 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:30.634500 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7cabe-94ff-4966-9ea0-bc64cbd43f04 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:30.634932 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a3e99-49e3-4f36-a337-dff47a7a1cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:30.635575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a3e99-49e3-4f36-a337-dff47a7a1cde None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:30.635877 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a3e99-49e3-4f36-a337-dff47a7a1cde None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:30.636145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a3e99-49e3-4f36-a337-dff47a7a1cde None admin] PATH_INFO: `/v3/projects` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:30.636917 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a3e99-49e3-4f36-a337-dff47a7a1cde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:30.637219 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a3e99-49e3-4f36-a337-dff47a7a1cde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:30.638645 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a3e99-49e3-4f36-a337-dff47a7a1cde None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:30.642096 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7cabe-94ff-4966-9ea0-bc64cbd43f04 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:30.643516 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7cabe-94ff-4966-9ea0-bc64cbd43f04 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:30.650501 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 290/563] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:53:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:30.651286 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a3e99-49e3-4f36-a337-dff47a7a1cde None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:30.658179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-0ab7cabe-94ff-4966-9ea0-bc64cbd43f04 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 16:53:30.658179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:30.658179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:30.658179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:30.658179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:30.658179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:30.658179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:30.658179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:30.658179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:30.658179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:30.658179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:30.658179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:30.658179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:53:30.658179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:53:30.658179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:53:30.658179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:53:30.659292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:30.659292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:30.659292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:53:30.659292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:30.659292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:53:30.659292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:30.659292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:30.659292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:30.659292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:30.659292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:30.659292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:30.659292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:30.659292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:30.659292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:30.659292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:30.659292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:30.659292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:30.659292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:30.660529 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:30.660529 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:30.660529 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:53:30.660529 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:53:30.660529 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:53:30.660529 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:53:30.660529 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:53:30.660529 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:53:30.660529 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 16:53:30.660529 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:30.660529 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 274/564] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:53:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:30.660529 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7cabe-94ff-4966-9ea0-bc64cbd43f04 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:30.746311 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a3e99-49e3-4f36-a337-dff47a7a1cde None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:30.752448 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7cabe-94ff-4966-9ea0-bc64cbd43f04 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:30.781805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf9d27-caba-4fe7-a202-d3f96e0ad7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:30.782456 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf9d27-caba-4fe7-a202-d3f96e0ad7ad None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:30.782734 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf9d27-caba-4fe7-a202-d3f96e0ad7ad None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:30.783004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf9d27-caba-4fe7-a202-d3f96e0ad7ad None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:30.783747 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf9d27-caba-4fe7-a202-d3f96e0ad7ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:30.784051 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf9d27-caba-4fe7-a202-d3f96e0ad7ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:30.785431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf9d27-caba-4fe7-a202-d3f96e0ad7ad None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:30.785607 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b709c7-9e3a-469e-b8f7-d7cb9c67e4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:30.786259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b709c7-9e3a-469e-b8f7-d7cb9c67e4a3 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:30.786537 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b709c7-9e3a-469e-b8f7-d7cb9c67e4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:30.786813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b709c7-9e3a-469e-b8f7-d7cb9c67e4a3 None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:30.787525 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b709c7-9e3a-469e-b8f7-d7cb9c67e4a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:30.787862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b709c7-9e3a-469e-b8f7-d7cb9c67e4a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:30.789272 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b709c7-9e3a-469e-b8f7-d7cb9c67e4a3 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:30.796317 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 291/565] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:30.797089 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf9d27-caba-4fe7-a202-d3f96e0ad7ad None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:30.800892 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 275/566] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:30.801702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b709c7-9e3a-469e-b8f7-d7cb9c67e4a3 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:30.894021 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf9d27-caba-4fe7-a202-d3f96e0ad7ad None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:30.894516 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b709c7-9e3a-469e-b8f7-d7cb9c67e4a3 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:30.928402 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16345e-e633-43cf-8890-13951af5423e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:30.929077 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58b920-e79f-4796-85da-54b2495e9ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:30.929991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58b920-e79f-4796-85da-54b2495e9ddc None admin] REQUEST_METHOD: `PUT` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:30.930272 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58b920-e79f-4796-85da-54b2495e9ddc None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:30.930545 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58b920-e79f-4796-85da-54b2495e9ddc None admin] PATH_INFO: `/v3/projects/d2ccefb3ecb0493bb0240a3853bfa5ff/users/cd52d2543a9f4b5d9270a12544b0a021/roles/0f1a9958b7874b10b41712760f0b6ffa` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:30.930637 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16345e-e633-43cf-8890-13951af5423e None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:30.930933 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16345e-e633-43cf-8890-13951af5423e None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:30.931211 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16345e-e633-43cf-8890-13951af5423e None admin] PATH_INFO: `/v3/users` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:30.932776 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16345e-e633-43cf-8890-13951af5423e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:30.933359 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16345e-e633-43cf-8890-13951af5423e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:30.935440 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16345e-e633-43cf-8890-13951af5423e None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:30.945707 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58b920-e79f-4796-85da-54b2495e9ddc None admin] RBAC: Authorizing `identity:create_grant(project_id=d2ccefb3ecb0493bb0240a3853bfa5ff, user_id=cd52d2543a9f4b5d9270a12544b0a021, role_id=0f1a9958b7874b10b41712760f0b6ffa)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:30.947212 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58b920-e79f-4796-85da-54b2495e9ddc None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:30.954826 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 276/567] 10.222.0.64 () {56 vars in 1137 bytes} [Thu May 12 16:53:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:30.955679 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16345e-e633-43cf-8890-13951af5423e None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:30.972249 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 292/568] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 12 16:53:30 2022] PUT /identity/v3/projects/d2ccefb3ecb0493bb0240a3853bfa5ff/users/cd52d2543a9f4b5d9270a12544b0a021/roles/0f1a9958b7874b10b41712760f0b6ffa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:53:30.973140 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58b920-e79f-4796-85da-54b2495e9ddc None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:31.081507 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16345e-e633-43cf-8890-13951af5423e None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:31.089319 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58b920-e79f-4796-85da-54b2495e9ddc None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:31.116904 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e749b-f1b0-4686-9e1e-d8c8e93e8643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:31.118189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e749b-f1b0-4686-9e1e-d8c8e93e8643 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:31.118465 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e749b-f1b0-4686-9e1e-d8c8e93e8643 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:31.118734 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e749b-f1b0-4686-9e1e-d8c8e93e8643 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:31.126700 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38131fd-1659-4ca7-b98f-9e6949bead6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:31.126936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e749b-f1b0-4686-9e1e-d8c8e93e8643 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:31.127658 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38131fd-1659-4ca7-b98f-9e6949bead6b None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:31.127953 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38131fd-1659-4ca7-b98f-9e6949bead6b None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:31.128229 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38131fd-1659-4ca7-b98f-9e6949bead6b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:31.128323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e749b-f1b0-4686-9e1e-d8c8e93e8643 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:31.136016 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38131fd-1659-4ca7-b98f-9e6949bead6b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:31.137500 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38131fd-1659-4ca7-b98f-9e6949bead6b None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:31.143322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-632e749b-f1b0-4686-9e1e-d8c8e93e8643 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:31.143322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:31.143322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:31.143322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:31.143322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:31.143322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:31.143322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:31.143322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:31.143322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:31.143322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:31.143322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:31.143322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:31.143322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:53:31.143322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:53:31.143322 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:53:31.144329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:53:31.144329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:31.144329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:31.144329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:31.144329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:31.144329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:31.144329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:31.144329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:31.144329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:31.144329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:31.144329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:31.144329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:31.144329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:31.144329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:31.144329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:31.144329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:31.144329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:31.150312 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:53:31.150312 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:53:31.150312 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:53:31.150312 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:53:31.150312 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:53:31.150312 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:53:31.150312 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:31.150312 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:31.150312 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 277/569] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:31.150312 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e749b-f1b0-4686-9e1e-d8c8e93e8643 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:31.153679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-d38131fd-1659-4ca7-b98f-9e6949bead6b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 16:53:31.153679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:31.153679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:31.153679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:31.153679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:31.153679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:31.153679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:31.153679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:31.153679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:31.153679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:31.153679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:31.153679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:31.153679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:53:31.153679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:53:31.153679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:53:31.153679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:53:31.154710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:31.154710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:31.154710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:53:31.154710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:31.154710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:53:31.154710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:31.154710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:31.154710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:31.154710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:31.154710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:31.154710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:31.154710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:31.154710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:31.154710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:31.154710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:31.154710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:31.154710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:31.154710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:31.156112 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:31.156112 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:31.156112 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:53:31.156112 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:53:31.156112 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:53:31.156112 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:53:31.156112 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:53:31.156112 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:53:31.156112 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 16:53:31.156112 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:31.160218 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 293/570] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 12 16:53:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:31.160609 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38131fd-1659-4ca7-b98f-9e6949bead6b None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:31.260978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e749b-f1b0-4686-9e1e-d8c8e93e8643 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:31.265223 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38131fd-1659-4ca7-b98f-9e6949bead6b None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:31.298053 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08c66b-9e12-4af9-8804-7eed5b54e655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:31.298842 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08c66b-9e12-4af9-8804-7eed5b54e655 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:31.299120 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08c66b-9e12-4af9-8804-7eed5b54e655 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:31.299489 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08c66b-9e12-4af9-8804-7eed5b54e655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:31.309761 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08c66b-9e12-4af9-8804-7eed5b54e655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:31.311784 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08c66b-9e12-4af9-8804-7eed5b54e655 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:31.318201 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea3a3e-859f-4b7f-abca-f7d77760d206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:31.318939 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea3a3e-859f-4b7f-abca-f7d77760d206 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:31.319152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea3a3e-859f-4b7f-abca-f7d77760d206 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:31.319415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea3a3e-859f-4b7f-abca-f7d77760d206 None admin] PATH_INFO: `/v3/projects` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:31.320235 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea3a3e-859f-4b7f-abca-f7d77760d206 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:31.320547 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea3a3e-859f-4b7f-abca-f7d77760d206 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:31.321987 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea3a3e-859f-4b7f-abca-f7d77760d206 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:31.329132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-7a08c66b-9e12-4af9-8804-7eed5b54e655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:31.329132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:31.329132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:31.329132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:31.329132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:31.329132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:31.329132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:31.329132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:31.329132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:31.329132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:31.329132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:31.329132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:31.329132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:31.329132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:31.329132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:31.330205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:31.330205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:31.330205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:31.330205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:31.330205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:31.330205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:31.330205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:31.330205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:31.330205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:31.330205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:31.330205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:31.330205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:31.330205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:31.330205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:31.330205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:31.330205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:31.330205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:31.331595 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:31.331595 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:31.331595 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:31.331595 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:31.334903 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 278/571] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:31.335533 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08c66b-9e12-4af9-8804-7eed5b54e655 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:31.342096 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 294/572] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:53:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:31.342096 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea3a3e-859f-4b7f-abca-f7d77760d206 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:31.437189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08c66b-9e12-4af9-8804-7eed5b54e655 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:31.437847 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea3a3e-859f-4b7f-abca-f7d77760d206 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:31.469547 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de52e22-59f8-4765-b536-286a1c02e572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:31.469983 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f7aad-2f8c-49e5-a8f9-f384b06cf649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:31.470218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de52e22-59f8-4765-b536-286a1c02e572 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:31.470503 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de52e22-59f8-4765-b536-286a1c02e572 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:31.470669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f7aad-2f8c-49e5-a8f9-f384b06cf649 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:31.470766 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de52e22-59f8-4765-b536-286a1c02e572 None admin] PATH_INFO: `/v3/users` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:31.470911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f7aad-2f8c-49e5-a8f9-f384b06cf649 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:31.471184 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f7aad-2f8c-49e5-a8f9-f384b06cf649 None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:31.471603 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de52e22-59f8-4765-b536-286a1c02e572 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:31.471934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f7aad-2f8c-49e5-a8f9-f384b06cf649 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:31.472030 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de52e22-59f8-4765-b536-286a1c02e572 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:31.472241 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f7aad-2f8c-49e5-a8f9-f384b06cf649 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:31.473368 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de52e22-59f8-4765-b536-286a1c02e572 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:31.473596 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f7aad-2f8c-49e5-a8f9-f384b06cf649 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:31.486085 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 295/573] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:31.486883 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f7aad-2f8c-49e5-a8f9-f384b06cf649 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:31.492145 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 279/574] 10.222.0.64 () {56 vars in 1139 bytes} [Thu May 12 16:53:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:31.493339 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de52e22-59f8-4765-b536-286a1c02e572 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:31.582246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f7aad-2f8c-49e5-a8f9-f384b06cf649 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:31.591411 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de52e22-59f8-4765-b536-286a1c02e572 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:31.616242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ff9db-e2d9-4a95-a25b-a6dc39ebb618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:31.617270 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ff9db-e2d9-4a95-a25b-a6dc39ebb618 None admin] REQUEST_METHOD: `PUT` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:31.617624 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ff9db-e2d9-4a95-a25b-a6dc39ebb618 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:31.617870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ff9db-e2d9-4a95-a25b-a6dc39ebb618 None admin] PATH_INFO: `/v3/projects/d2ccefb3ecb0493bb0240a3853bfa5ff/users/deb66d4bda564438852a38a4a4116ccb/roles/0f1a9958b7874b10b41712760f0b6ffa` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:31.627728 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd384519-7a70-47ec-b450-39c72c0166e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:31.628523 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd384519-7a70-47ec-b450-39c72c0166e1 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:31.628807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd384519-7a70-47ec-b450-39c72c0166e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:31.629074 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd384519-7a70-47ec-b450-39c72c0166e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:31.632821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ff9db-e2d9-4a95-a25b-a6dc39ebb618 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2ccefb3ecb0493bb0240a3853bfa5ff, user_id=deb66d4bda564438852a38a4a4116ccb, role_id=0f1a9958b7874b10b41712760f0b6ffa)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:31.634271 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ff9db-e2d9-4a95-a25b-a6dc39ebb618 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:31.635672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd384519-7a70-47ec-b450-39c72c0166e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:31.637115 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd384519-7a70-47ec-b450-39c72c0166e1 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:31.647006 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 296/575] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 12 16:53:31 2022] PUT /identity/v3/projects/d2ccefb3ecb0493bb0240a3853bfa5ff/users/deb66d4bda564438852a38a4a4116ccb/roles/0f1a9958b7874b10b41712760f0b6ffa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:53:31.651968 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-bd384519-7a70-47ec-b450-39c72c0166e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:31.651968 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:31.651968 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:31.651968 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:31.651968 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:31.651968 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:31.651968 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:31.651968 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:31.651968 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:31.651968 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:31.651968 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:31.651968 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:31.651968 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:53:31.651968 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:53:31.651968 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:53:31.652882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:53:31.652882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:31.652882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:31.652882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:31.652882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:31.652882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:31.652882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:31.652882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:31.652882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:31.652882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:31.652882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:31.652882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:31.652882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:31.652882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:31.652882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:31.652882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:31.652882 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:31.653773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:53:31.653773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:53:31.653773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:53:31.653773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:53:31.653773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:53:31.653773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:53:31.653773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:31.653773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:31.655536 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ff9db-e2d9-4a95-a25b-a6dc39ebb618 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:31.658315 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 280/576] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:31.659306 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd384519-7a70-47ec-b450-39c72c0166e1 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:31.772498 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd384519-7a70-47ec-b450-39c72c0166e1 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:31.776258 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ff9db-e2d9-4a95-a25b-a6dc39ebb618 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:31.814992 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f72f6f-c6c3-4952-ae0b-de33a753045f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:31.815927 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f72f6f-c6c3-4952-ae0b-de33a753045f None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:31.816213 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f72f6f-c6c3-4952-ae0b-de33a753045f None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:31.816485 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f72f6f-c6c3-4952-ae0b-de33a753045f None admin] PATH_INFO: `/v3/projects` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:31.817292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f72f6f-c6c3-4952-ae0b-de33a753045f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:31.817601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f72f6f-c6c3-4952-ae0b-de33a753045f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:31.819072 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f72f6f-c6c3-4952-ae0b-de33a753045f None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:31.823810 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71325c-1e39-4547-b434-25fdb8cf03d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:31.824967 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71325c-1e39-4547-b434-25fdb8cf03d1 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:31.825453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71325c-1e39-4547-b434-25fdb8cf03d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:31.825919 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71325c-1e39-4547-b434-25fdb8cf03d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:31.833617 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 281/577] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:53:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:31.839024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71325c-1e39-4547-b434-25fdb8cf03d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:31.839833 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f72f6f-c6c3-4952-ae0b-de33a753045f None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:31.841166 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71325c-1e39-4547-b434-25fdb8cf03d1 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:31.860008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-4e71325c-1e39-4547-b434-25fdb8cf03d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:31.860008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:31.860008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:31.860008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:31.860008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:31.860008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:31.860008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:31.860008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:31.860008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:31.860008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:31.860008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:31.860008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:31.860008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:31.860008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:31.860008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:31.860934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:31.860934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:31.860934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:31.860934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:31.860934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:31.860934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:31.860934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:31.860934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:31.860934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:31.860934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:31.860934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:31.860934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:31.860934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:31.860934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:31.860934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:31.860934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:31.860934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:31.861961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:31.861961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:31.861961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:31.861961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:31.863901 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 297/578] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:31.869159 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71325c-1e39-4547-b434-25fdb8cf03d1 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:31.954947 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f72f6f-c6c3-4952-ae0b-de33a753045f None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:31.975037 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71325c-1e39-4547-b434-25fdb8cf03d1 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:31.989813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e44bdc-21c8-4bb9-8e87-ca14621e4637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:31.990733 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e44bdc-21c8-4bb9-8e87-ca14621e4637 None admin] REQUEST_METHOD: `PUT` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:31.990972 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e44bdc-21c8-4bb9-8e87-ca14621e4637 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:31.991245 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e44bdc-21c8-4bb9-8e87-ca14621e4637 None admin] PATH_INFO: `/v3/projects/d2ccefb3ecb0493bb0240a3853bfa5ff/users/83541095ea5646038feef0764f0473c0/roles/0f1a9958b7874b10b41712760f0b6ffa` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:32.006462 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e44bdc-21c8-4bb9-8e87-ca14621e4637 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2ccefb3ecb0493bb0240a3853bfa5ff, user_id=83541095ea5646038feef0764f0473c0, role_id=0f1a9958b7874b10b41712760f0b6ffa)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:32.007950 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e44bdc-21c8-4bb9-8e87-ca14621e4637 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:32.012174 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1ecf3-e6e2-4d8f-9056-4767cc20c7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:32.013144 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1ecf3-e6e2-4d8f-9056-4767cc20c7d1 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:32.014269 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1ecf3-e6e2-4d8f-9056-4767cc20c7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:32.014778 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1ecf3-e6e2-4d8f-9056-4767cc20c7d1 None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:32.015777 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1ecf3-e6e2-4d8f-9056-4767cc20c7d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:32.016390 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1ecf3-e6e2-4d8f-9056-4767cc20c7d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:32.017986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d1ecf3-e6e2-4d8f-9056-4767cc20c7d1 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:32.027981 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 282/579] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 12 16:53:31 2022] PUT /identity/v3/projects/d2ccefb3ecb0493bb0240a3853bfa5ff/users/83541095ea5646038feef0764f0473c0/roles/0f1a9958b7874b10b41712760f0b6ffa => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:53:32.031274 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 298/580] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:32.036688 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e44bdc-21c8-4bb9-8e87-ca14621e4637 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:32.152483 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e44bdc-21c8-4bb9-8e87-ca14621e4637 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:32.191400 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d91ea-47c7-419a-97ab-00a08b79a107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:32.192293 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d91ea-47c7-419a-97ab-00a08b79a107 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:32.192573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d91ea-47c7-419a-97ab-00a08b79a107 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:32.192847 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d91ea-47c7-419a-97ab-00a08b79a107 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:32.200396 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d91ea-47c7-419a-97ab-00a08b79a107 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:32.202408 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d91ea-47c7-419a-97ab-00a08b79a107 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:32.221763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-468d91ea-47c7-419a-97ab-00a08b79a107 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:32.221763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:32.221763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:32.221763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:32.221763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:32.221763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:32.221763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:32.221763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:32.221763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:32.221763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:32.221763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:32.221763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:32.221763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:53:32.221763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:53:32.221763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:53:32.222702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:53:32.222702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:32.222702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:32.222702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:32.222702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:32.222702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:32.222702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:32.222702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:32.222702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:32.222702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:32.222702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:32.222702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:32.222702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:32.222702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:32.222702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:32.222702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:32.222702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:32.223554 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:53:32.223554 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:53:32.223554 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:53:32.223554 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:53:32.223554 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:53:32.223554 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:53:32.223554 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:32.223554 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:32.223554 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 283/581] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:32.229565 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1ecf3-e6e2-4d8f-9056-4767cc20c7d1 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:32.334410 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1ecf3-e6e2-4d8f-9056-4767cc20c7d1 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:32.369425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d06b5c-e410-4218-b8a3-1b8b3bbebca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:32.370438 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d06b5c-e410-4218-b8a3-1b8b3bbebca1 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:32.370915 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d06b5c-e410-4218-b8a3-1b8b3bbebca1 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:32.371383 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d06b5c-e410-4218-b8a3-1b8b3bbebca1 None admin] PATH_INFO: `/v3/projects` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:32.372420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d06b5c-e410-4218-b8a3-1b8b3bbebca1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:32.372923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d06b5c-e410-4218-b8a3-1b8b3bbebca1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:32.375151 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d06b5c-e410-4218-b8a3-1b8b3bbebca1 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:32.387842 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 299/582] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:53:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:32.393945 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d91ea-47c7-419a-97ab-00a08b79a107 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:32.495919 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d91ea-47c7-419a-97ab-00a08b79a107 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:32.531978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060b417-ffcc-42b3-a23d-5bfc9c70be74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:32.533879 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060b417-ffcc-42b3-a23d-5bfc9c70be74 None admin] REQUEST_METHOD: `PUT` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:32.534406 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060b417-ffcc-42b3-a23d-5bfc9c70be74 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:32.534946 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060b417-ffcc-42b3-a23d-5bfc9c70be74 None admin] PATH_INFO: `/v3/projects/d2ccefb3ecb0493bb0240a3853bfa5ff/users/b2cc0957b3e2402b8e6f47d46bfa02be/roles/0f1a9958b7874b10b41712760f0b6ffa` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:32.551983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060b417-ffcc-42b3-a23d-5bfc9c70be74 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2ccefb3ecb0493bb0240a3853bfa5ff, user_id=b2cc0957b3e2402b8e6f47d46bfa02be, role_id=0f1a9958b7874b10b41712760f0b6ffa)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:32.553821 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060b417-ffcc-42b3-a23d-5bfc9c70be74 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:32.571841 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 284/583] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 12 16:53:32 2022] PUT /identity/v3/projects/d2ccefb3ecb0493bb0240a3853bfa5ff/users/b2cc0957b3e2402b8e6f47d46bfa02be/roles/0f1a9958b7874b10b41712760f0b6ffa => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:53:33.388156 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccd825-7190-48b6-bb93-484442019341 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:33.388727 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccd825-7190-48b6-bb93-484442019341 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:33.388727 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccd825-7190-48b6-bb93-484442019341 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:33.390376 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 300/584] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:33.395589 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cce057-bbd5-47be-ae0e-8a38e8954b4e None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:33.396017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cce057-bbd5-47be-ae0e-8a38e8954b4e None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:33.396201 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cce057-bbd5-47be-ae0e-8a38e8954b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:33.413506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-a1cce057-bbd5-47be-ae0e-8a38e8954b4e None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:33.414883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-a1cce057-bbd5-47be-ae0e-8a38e8954b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:33.483504 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 285/585] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:33.507352 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccd825-7190-48b6-bb93-484442019341 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:33.610265 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccd825-7190-48b6-bb93-484442019341 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:33.644247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc1f13-cb68-41e4-bba0-dfd9057da0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:33.644969 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc1f13-cb68-41e4-bba0-dfd9057da0d2 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:33.645254 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc1f13-cb68-41e4-bba0-dfd9057da0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:33.645533 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc1f13-cb68-41e4-bba0-dfd9057da0d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:33.655983 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc1f13-cb68-41e4-bba0-dfd9057da0d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:33.663855 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-47bc1f13-cb68-41e4-bba0-dfd9057da0d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:33.663855 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:33.663855 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:33.663855 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:33.663855 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:33.663855 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:33.663855 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:33.663855 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:33.663855 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:33.663855 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:33.663855 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:33.663855 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:33.663855 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:33.663855 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:33.663855 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:33.663855 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:33.665562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:33.665562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:33.665562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:33.665562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:33.665562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:33.665562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:33.665562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:33.665562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:33.665562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:33.665562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:33.665562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:33.665562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:33.665562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:33.665562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:33.665562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:33.665562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:33.667833 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:33.667833 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:33.667833 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:33.667833 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:33.667833 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:33.667833 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:33.667833 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:33.667833 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:33.667833 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:33.667833 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:33.667833 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:33.667833 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:33.667833 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 301/586] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 12 16:53:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:33.672007 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cce057-bbd5-47be-ae0e-8a38e8954b4e None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:33.773591 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cce057-bbd5-47be-ae0e-8a38e8954b4e None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:33.808799 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41797a43-f975-4bbd-b738-0e18ccac47bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:33.809504 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41797a43-f975-4bbd-b738-0e18ccac47bf None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:33.809788 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41797a43-f975-4bbd-b738-0e18ccac47bf None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:33.810064 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41797a43-f975-4bbd-b738-0e18ccac47bf None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:33.810930 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41797a43-f975-4bbd-b738-0e18ccac47bf None admin] RBAC: Adding query filter params (name=service) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:33.811243 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41797a43-f975-4bbd-b738-0e18ccac47bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:33.812702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41797a43-f975-4bbd-b738-0e18ccac47bf None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:33.823091 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 286/587] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 12 16:53:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:33.829337 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc1f13-cb68-41e4-bba0-dfd9057da0d2 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:33.941863 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc1f13-cb68-41e4-bba0-dfd9057da0d2 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:33.976632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743ccbb-ee1a-4e60-b7ed-d1122fa84b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:33.977431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743ccbb-ee1a-4e60-b7ed-d1122fa84b0a None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:33.977711 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743ccbb-ee1a-4e60-b7ed-d1122fa84b0a None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:33.977984 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743ccbb-ee1a-4e60-b7ed-d1122fa84b0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:33.989779 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743ccbb-ee1a-4e60-b7ed-d1122fa84b0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:33.991256 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3743ccbb-ee1a-4e60-b7ed-d1122fa84b0a None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:34.008791 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-3743ccbb-ee1a-4e60-b7ed-d1122fa84b0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:34.008791 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:34.008791 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:34.008791 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:34.008791 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:34.008791 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:34.008791 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:34.008791 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:34.008791 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:34.008791 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:34.008791 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:34.008791 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:34.008791 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:34.008791 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:34.008791 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:34.009701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:34.009701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:34.009701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:34.009701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:34.009701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:34.009701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:34.009701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:34.009701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:34.009701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:34.009701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:34.009701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:34.009701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:34.009701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:34.009701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:34.009701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:34.009701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:34.009701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:34.011546 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:34.011546 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:34.011546 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:34.011546 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:34.011546 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 302/588] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:34.016313 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79942f2d-8f8c-4cc6-8c10-e7c8c406d60e None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:34.016526 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743ccbb-ee1a-4e60-b7ed-d1122fa84b0a None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:34.016806 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79942f2d-8f8c-4cc6-8c10-e7c8c406d60e None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:34.016978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79942f2d-8f8c-4cc6-8c10-e7c8c406d60e None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:34.018360 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 287/589] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:34.023977 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e34c4e-8df4-437a-b58e-e64210de0dae None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:34.024266 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e34c4e-8df4-437a-b58e-e64210de0dae None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:34.024550 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e34c4e-8df4-437a-b58e-e64210de0dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:34.040817 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-62e34c4e-8df4-437a-b58e-e64210de0dae None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:34.041989 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-62e34c4e-8df4-437a-b58e-e64210de0dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:34.115972 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 288/590] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:53:34.131235 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743ccbb-ee1a-4e60-b7ed-d1122fa84b0a None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:34.132187 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e34c4e-8df4-437a-b58e-e64210de0dae None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:34.169853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586b2dc-8dc5-48d1-b182-06b2cd1d2fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:34.170959 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586b2dc-8dc5-48d1-b182-06b2cd1d2fd6 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:34.171239 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586b2dc-8dc5-48d1-b182-06b2cd1d2fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:34.171511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586b2dc-8dc5-48d1-b182-06b2cd1d2fd6 None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:34.172340 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586b2dc-8dc5-48d1-b182-06b2cd1d2fd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:34.172648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586b2dc-8dc5-48d1-b182-06b2cd1d2fd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:34.174094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586b2dc-8dc5-48d1-b182-06b2cd1d2fd6 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:34.198305 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 303/591] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:34.203992 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586b2dc-8dc5-48d1-b182-06b2cd1d2fd6 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:34.255822 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e34c4e-8df4-437a-b58e-e64210de0dae None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:34.290482 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e694e8-53ce-46be-baa2-952fce9ed8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:34.291276 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e694e8-53ce-46be-baa2-952fce9ed8e1 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:34.291555 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e694e8-53ce-46be-baa2-952fce9ed8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:34.291866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e694e8-53ce-46be-baa2-952fce9ed8e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:34.302970 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e694e8-53ce-46be-baa2-952fce9ed8e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:34.310807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-26e694e8-53ce-46be-baa2-952fce9ed8e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:34.310807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:34.310807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:34.310807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:34.310807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:34.310807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:34.310807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:34.310807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:34.310807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:34.310807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:34.310807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:34.310807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:34.310807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:34.310807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:34.310807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:34.310807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:34.312986 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:34.312986 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:34.312986 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:34.312986 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:34.312986 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:34.312986 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:34.312986 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:34.312986 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:34.312986 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:34.312986 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:34.312986 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:34.312986 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:34.312986 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:34.312986 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:34.312986 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:34.312986 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:34.315075 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:34.315075 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:34.315075 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:34.315075 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:34.315075 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:34.315075 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:34.315075 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:34.315075 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:34.315075 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:34.315075 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:34.315075 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:34.315075 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:34.319986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586b2dc-8dc5-48d1-b182-06b2cd1d2fd6 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:34.320184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 289/592] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 12 16:53:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:34.320184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e694e8-53ce-46be-baa2-952fce9ed8e1 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:34.348113 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e50f25-a92a-4f41-804a-432a8f0492f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:34.348908 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e50f25-a92a-4f41-804a-432a8f0492f7 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:34.349193 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e50f25-a92a-4f41-804a-432a8f0492f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:34.349471 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e50f25-a92a-4f41-804a-432a8f0492f7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:34.357203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e50f25-a92a-4f41-804a-432a8f0492f7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:34.359247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e50f25-a92a-4f41-804a-432a8f0492f7 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:34.374131 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-a7e50f25-a92a-4f41-804a-432a8f0492f7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 16:53:34.374131 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:34.374131 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:34.374131 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:34.374131 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:34.374131 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:34.374131 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:34.374131 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:34.374131 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:34.374131 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:34.374131 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:34.374131 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:34.374131 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:53:34.374131 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:53:34.374131 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:53:34.374131 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:53:34.375142 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:34.375142 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:34.375142 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:53:34.375142 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:34.375142 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:53:34.375142 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:34.375142 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:34.375142 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:34.375142 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:34.375142 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:34.375142 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:34.375142 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:34.375142 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:34.375142 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:34.375142 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:34.375142 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:34.375142 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:34.375142 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:34.376106 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:34.376106 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:34.376106 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:53:34.376106 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:53:34.376106 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:53:34.376106 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:53:34.376106 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:53:34.376106 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:53:34.376106 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 16:53:34.376106 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:34.376106 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 304/593] 10.222.0.64 () {56 vars in 1093 bytes} [Thu May 12 16:53:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:53:34.376708 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e1979-f574-4072-ba89-12bbb95ddc72 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:34.377291 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e1979-f574-4072-ba89-12bbb95ddc72 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:34.377291 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e1979-f574-4072-ba89-12bbb95ddc72 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:34.378492 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 305/594] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:34.383026 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e1979-f574-4072-ba89-12bbb95ddc72 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:34.426197 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e694e8-53ce-46be-baa2-952fce9ed8e1 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:34.460053 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4f1be-9a17-4db0-94b0-2acd10b435bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:34.460708 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4f1be-9a17-4db0-94b0-2acd10b435bf None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:34.460990 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4f1be-9a17-4db0-94b0-2acd10b435bf None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:34.461255 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4f1be-9a17-4db0-94b0-2acd10b435bf None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:34.461988 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4f1be-9a17-4db0-94b0-2acd10b435bf None admin] RBAC: Adding query filter params (name=service) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:34.462310 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4f1be-9a17-4db0-94b0-2acd10b435bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:34.463675 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4f1be-9a17-4db0-94b0-2acd10b435bf None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:34.477102 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 290/595] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 12 16:53:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:34.477102 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641c6c3-6ecc-4612-ae5b-9597f157601f None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:34.477102 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641c6c3-6ecc-4612-ae5b-9597f157601f None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:34.477102 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641c6c3-6ecc-4612-ae5b-9597f157601f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:34.482926 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e1979-f574-4072-ba89-12bbb95ddc72 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:34.492401 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-c641c6c3-6ecc-4612-ae5b-9597f157601f None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:34.493563 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-c641c6c3-6ecc-4612-ae5b-9597f157601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:34.518536 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284bf437-a1bc-4691-85cc-fe8095acc527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:34.519208 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bf437-a1bc-4691-85cc-fe8095acc527 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:34.519492 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bf437-a1bc-4691-85cc-fe8095acc527 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:34.519805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284bf437-a1bc-4691-85cc-fe8095acc527 None admin] PATH_INFO: `/v3/users` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:34.520638 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284bf437-a1bc-4691-85cc-fe8095acc527 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:34.520944 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284bf437-a1bc-4691-85cc-fe8095acc527 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:34.522425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284bf437-a1bc-4691-85cc-fe8095acc527 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:34.543682 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 306/596] 10.222.0.64 () {56 vars in 1133 bytes} [Thu May 12 16:53:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:34.543682 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284bf437-a1bc-4691-85cc-fe8095acc527 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:34.564871 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 291/597] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:34.565536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641c6c3-6ecc-4612-ae5b-9597f157601f None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:34.649430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284bf437-a1bc-4691-85cc-fe8095acc527 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:34.664254 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641c6c3-6ecc-4612-ae5b-9597f157601f None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:34.683723 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd1f90-316a-4ab5-8e76-f186b10d834d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:34.684445 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd1f90-316a-4ab5-8e76-f186b10d834d None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:34.684729 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd1f90-316a-4ab5-8e76-f186b10d834d None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:34.685006 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd1f90-316a-4ab5-8e76-f186b10d834d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:34.694745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd1f90-316a-4ab5-8e76-f186b10d834d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:34.696256 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd1f90-316a-4ab5-8e76-f186b10d834d None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:34.697565 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87a394-c356-4b3d-928f-fccdfe12feb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:34.698210 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87a394-c356-4b3d-928f-fccdfe12feb5 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:34.698491 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87a394-c356-4b3d-928f-fccdfe12feb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:34.698771 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87a394-c356-4b3d-928f-fccdfe12feb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:34.715512 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-6afd1f90-316a-4ab5-8e76-f186b10d834d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:34.715512 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:34.715512 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:34.715512 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:34.715512 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:34.715512 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:34.715512 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:34.715512 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:34.715512 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:34.715512 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:34.715512 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:34.715512 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:34.715512 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:34.715512 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:34.715512 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:34.716431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:34.716431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:34.716431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:34.716431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:34.716431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:34.716431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:34.716431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:34.716431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:34.716431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:34.716431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:34.716431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:34.716431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:34.716431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:34.716431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:34.716431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:34.716431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:34.716431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:34.717934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:34.717934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:34.717934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:34.717934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:34.719782 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 307/598] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:34.720819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd1f90-316a-4ab5-8e76-f186b10d834d None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:34.769861 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87a394-c356-4b3d-928f-fccdfe12feb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:34.771360 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87a394-c356-4b3d-928f-fccdfe12feb5 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:34.824348 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd1f90-316a-4ab5-8e76-f186b10d834d None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:34.858141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd7545-0626-4ee6-af5c-814a6ef0ebcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:34.858928 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd7545-0626-4ee6-af5c-814a6ef0ebcd None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:34.859208 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd7545-0626-4ee6-af5c-814a6ef0ebcd None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:34.859478 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd7545-0626-4ee6-af5c-814a6ef0ebcd None admin] PATH_INFO: `/v3/roles/service` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:34.869323 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd7545-0626-4ee6-af5c-814a6ef0ebcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:34.877403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 292/599] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:53:34.877403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87a394-c356-4b3d-928f-fccdfe12feb5 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:34.878141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-67bd7545-0626-4ee6-af5c-814a6ef0ebcd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:34.878141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:34.878141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:34.878141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:34.878141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:34.878141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:34.878141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:34.878141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:34.878141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:34.878141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:34.878141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:34.878141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:34.878141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:34.878141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:34.878141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:34.878141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:34.879337 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:34.879337 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:34.879337 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:34.879337 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:34.879337 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:34.879337 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:34.879337 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:34.879337 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:34.879337 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:34.879337 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:34.879337 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:34.879337 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:34.879337 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:34.879337 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:34.879337 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:34.879337 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:34.880402 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:34.880402 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:34.880402 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:34.880402 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:34.880402 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:34.880402 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:34.880402 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:34.880402 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:34.880402 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:34.880402 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:34.880402 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:34.880402 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:34.880402 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 308/600] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 12 16:53:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:34.880402 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd7545-0626-4ee6-af5c-814a6ef0ebcd None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:34.985383 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87a394-c356-4b3d-928f-fccdfe12feb5 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:34.985706 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd7545-0626-4ee6-af5c-814a6ef0ebcd None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:35.017305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee455cf7-ff41-4adf-93db-4d92c3692bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:35.017762 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcf1d6-580c-4412-ab5b-21c0b55169a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:35.017949 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee455cf7-ff41-4adf-93db-4d92c3692bdd None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:35.018226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee455cf7-ff41-4adf-93db-4d92c3692bdd None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:35.018497 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee455cf7-ff41-4adf-93db-4d92c3692bdd None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:35.018588 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcf1d6-580c-4412-ab5b-21c0b55169a3 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:35.018805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcf1d6-580c-4412-ab5b-21c0b55169a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:35.019079 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcf1d6-580c-4412-ab5b-21c0b55169a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:35.019202 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee455cf7-ff41-4adf-93db-4d92c3692bdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:35.019502 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee455cf7-ff41-4adf-93db-4d92c3692bdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:35.020895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee455cf7-ff41-4adf-93db-4d92c3692bdd None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:35.029104 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcf1d6-580c-4412-ab5b-21c0b55169a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:35.030608 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcf1d6-580c-4412-ab5b-21c0b55169a3 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:35.031537 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 293/601] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:35.032363 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee455cf7-ff41-4adf-93db-4d92c3692bdd None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:35.048562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-22dcf1d6-580c-4412-ab5b-21c0b55169a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:35.048562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:35.048562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:35.048562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:35.048562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:35.048562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:35.048562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:35.048562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:35.048562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:35.048562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:35.048562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:35.048562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:35.048562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:35.048562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:35.048562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:35.049656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:35.049656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:35.049656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:35.049656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:35.049656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:35.049656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:35.049656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:35.049656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:35.049656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:35.049656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:35.049656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:35.049656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:35.049656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:35.049656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:35.049656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:35.049656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:35.049656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:35.050596 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:35.050596 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:35.050596 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:35.050596 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:35.050596 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 309/602] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:35.051099 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bcbc2-2310-4f84-8b61-0c6085b53824 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:35.051387 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bcbc2-2310-4f84-8b61-0c6085b53824 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:35.051685 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bcbc2-2310-4f84-8b61-0c6085b53824 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:35.055769 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 310/603] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:35.056651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bcbc2-2310-4f84-8b61-0c6085b53824 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:35.128594 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee455cf7-ff41-4adf-93db-4d92c3692bdd None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:35.152840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bcbc2-2310-4f84-8b61-0c6085b53824 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:35.159309 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa689d-37d2-4e6d-8cb1-4b7b1f80317a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:35.160003 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa689d-37d2-4e6d-8cb1-4b7b1f80317a None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:35.160287 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa689d-37d2-4e6d-8cb1-4b7b1f80317a None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:35.160565 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa689d-37d2-4e6d-8cb1-4b7b1f80317a None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:35.161305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa689d-37d2-4e6d-8cb1-4b7b1f80317a None admin] RBAC: Adding query filter params (name=service) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:35.161612 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa689d-37d2-4e6d-8cb1-4b7b1f80317a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:35.162976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa689d-37d2-4e6d-8cb1-4b7b1f80317a None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:35.171032 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 294/604] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 12 16:53:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:35.171843 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa689d-37d2-4e6d-8cb1-4b7b1f80317a None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:35.185237 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57837bb-6bad-4f82-8384-cb6b9fd5cf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:35.186576 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57837bb-6bad-4f82-8384-cb6b9fd5cf40 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:35.186855 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57837bb-6bad-4f82-8384-cb6b9fd5cf40 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:35.187125 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57837bb-6bad-4f82-8384-cb6b9fd5cf40 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:35.194502 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57837bb-6bad-4f82-8384-cb6b9fd5cf40 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:35.196048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57837bb-6bad-4f82-8384-cb6b9fd5cf40 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:35.209722 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-d57837bb-6bad-4f82-8384-cb6b9fd5cf40 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 16:53:35.209722 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:35.209722 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:35.209722 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:35.209722 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:35.209722 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:35.209722 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:35.209722 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:35.209722 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:35.209722 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:35.209722 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:35.209722 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:35.209722 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:53:35.209722 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:53:35.209722 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:53:35.209722 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:53:35.210811 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:35.210811 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:35.210811 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:53:35.210811 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:35.210811 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:53:35.210811 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:35.210811 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:35.210811 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:35.210811 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:35.210811 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:35.210811 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:35.210811 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:35.210811 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:35.210811 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:35.210811 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:35.210811 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:35.210811 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:35.210811 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:35.211794 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:35.211794 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:35.211794 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:53:35.211794 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:53:35.211794 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:53:35.211794 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:53:35.211794 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:53:35.211794 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:53:35.211794 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 16:53:35.211794 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:35.211794 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 311/605] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:53:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:35.212495 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a62ed2-8a9f-4378-b1c7-1daf32fc5079 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:35.212581 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a62ed2-8a9f-4378-b1c7-1daf32fc5079 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:35.212851 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a62ed2-8a9f-4378-b1c7-1daf32fc5079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:35.228750 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-e9a62ed2-8a9f-4378-b1c7-1daf32fc5079 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:35.229912 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-e9a62ed2-8a9f-4378-b1c7-1daf32fc5079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:35.276956 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa689d-37d2-4e6d-8cb1-4b7b1f80317a None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:35.291354 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 312/606] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:35.292211 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a62ed2-8a9f-4378-b1c7-1daf32fc5079 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:35.317114 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69b021-2e91-46f5-b09f-ccac22937e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:35.317906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69b021-2e91-46f5-b09f-ccac22937e4f None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:35.318181 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69b021-2e91-46f5-b09f-ccac22937e4f None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:35.318458 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69b021-2e91-46f5-b09f-ccac22937e4f None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:35.319167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69b021-2e91-46f5-b09f-ccac22937e4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:35.319470 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69b021-2e91-46f5-b09f-ccac22937e4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:35.320857 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69b021-2e91-46f5-b09f-ccac22937e4f None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:35.332151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 295/607] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:35.332943 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69b021-2e91-46f5-b09f-ccac22937e4f None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:35.387658 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a62ed2-8a9f-4378-b1c7-1daf32fc5079 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:35.420155 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fe763-e615-4b45-9393-473217c8ec04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:35.421020 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fe763-e615-4b45-9393-473217c8ec04 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:35.421299 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fe763-e615-4b45-9393-473217c8ec04 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:35.421570 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fe763-e615-4b45-9393-473217c8ec04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:35.425738 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69b021-2e91-46f5-b09f-ccac22937e4f None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:35.431220 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fe763-e615-4b45-9393-473217c8ec04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:35.432731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fe763-e615-4b45-9393-473217c8ec04 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:35.449895 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-bf4fe763-e615-4b45-9393-473217c8ec04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:35.449895 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:35.449895 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:35.449895 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:35.449895 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:35.449895 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:35.449895 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:35.449895 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:35.449895 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:35.449895 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:35.449895 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:35.449895 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:35.449895 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:35.449895 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:35.449895 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:35.450819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:35.450819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:35.450819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:35.450819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:35.450819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:35.450819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:35.450819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:35.450819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:35.450819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:35.450819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:35.450819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:35.450819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:35.450819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:35.450819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:35.450819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:35.450819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:35.450819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:35.451922 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:35.451922 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:35.451922 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:35.451922 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:35.451922 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 313/608] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:35.452616 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fe763-e615-4b45-9393-473217c8ec04 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:35.461950 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3976f-6844-4fc0-a7f7-37a4c47c78f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:35.462605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3976f-6844-4fc0-a7f7-37a4c47c78f5 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:35.462887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3976f-6844-4fc0-a7f7-37a4c47c78f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:35.463159 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3976f-6844-4fc0-a7f7-37a4c47c78f5 None admin] PATH_INFO: `/v3/users` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:35.464027 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3976f-6844-4fc0-a7f7-37a4c47c78f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:35.464338 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3976f-6844-4fc0-a7f7-37a4c47c78f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:35.465777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3976f-6844-4fc0-a7f7-37a4c47c78f5 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:35.483394 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 296/609] 10.222.0.64 () {56 vars in 1137 bytes} [Thu May 12 16:53:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:35.484230 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3976f-6844-4fc0-a7f7-37a4c47c78f5 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:35.544113 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fe763-e615-4b45-9393-473217c8ec04 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:35.575379 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3976f-6844-4fc0-a7f7-37a4c47c78f5 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:35.575710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb15749-a042-4a2d-9ca1-c903b1bec9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:35.576521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb15749-a042-4a2d-9ca1-c903b1bec9d3 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:35.576800 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb15749-a042-4a2d-9ca1-c903b1bec9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:35.577070 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb15749-a042-4a2d-9ca1-c903b1bec9d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:35.586644 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb15749-a042-4a2d-9ca1-c903b1bec9d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:35.594815 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-1bb15749-a042-4a2d-9ca1-c903b1bec9d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:35.594815 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:35.594815 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:35.594815 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:35.594815 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:35.594815 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:35.594815 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:35.594815 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:35.594815 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:35.594815 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:35.594815 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:35.594815 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:35.594815 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:35.594815 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:35.594815 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:35.594815 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:35.595760 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:35.595760 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:35.595760 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:35.595760 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:35.595760 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:35.595760 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:35.595760 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:35.595760 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:35.595760 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:35.595760 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:35.595760 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:35.595760 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:35.595760 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:35.595760 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:35.595760 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:35.595760 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:35.596585 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:35.596585 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:35.596585 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:35.596585 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:35.596585 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:35.596585 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:35.596585 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:35.596585 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:35.596585 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:35.596585 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:35.596585 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:53:35.596585 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:35.596585 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 314/610] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 12 16:53:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:35.597636 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb15749-a042-4a2d-9ca1-c903b1bec9d3 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:35.612567 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1ca19-b78c-4072-b22f-da58ed80862d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:35.613351 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1ca19-b78c-4072-b22f-da58ed80862d None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:35.613632 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1ca19-b78c-4072-b22f-da58ed80862d None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:35.613904 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1ca19-b78c-4072-b22f-da58ed80862d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:35.620327 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1ca19-b78c-4072-b22f-da58ed80862d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:35.621806 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1ca19-b78c-4072-b22f-da58ed80862d None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:35.634999 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-36c1ca19-b78c-4072-b22f-da58ed80862d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:35.634999 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:35.634999 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:35.634999 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:35.634999 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:35.634999 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:35.634999 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:35.634999 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:35.634999 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:35.634999 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:35.634999 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:35.634999 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:35.634999 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:53:35.634999 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:53:35.634999 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:53:35.635978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:53:35.635978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:35.635978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:35.635978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:35.635978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:35.635978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:35.635978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:35.635978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:35.635978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:35.635978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:35.635978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:35.635978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:35.635978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:35.635978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:35.635978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:35.635978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:35.635978 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:35.636851 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:53:35.636851 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:53:35.636851 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:53:35.636851 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:53:35.636851 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:53:35.636851 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:53:35.636851 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:35.636851 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:35.636851 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 297/611] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:35.637342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1ca19-b78c-4072-b22f-da58ed80862d None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:35.694018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb15749-a042-4a2d-9ca1-c903b1bec9d3 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:35.725301 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba517de-ffc0-4320-b004-c0fdbe2d8b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:35.726226 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba517de-ffc0-4320-b004-c0fdbe2d8b95 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:35.726502 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba517de-ffc0-4320-b004-c0fdbe2d8b95 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:35.726776 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba517de-ffc0-4320-b004-c0fdbe2d8b95 None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:35.727491 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba517de-ffc0-4320-b004-c0fdbe2d8b95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:35.727828 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba517de-ffc0-4320-b004-c0fdbe2d8b95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:35.729200 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba517de-ffc0-4320-b004-c0fdbe2d8b95 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:35.729526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1ca19-b78c-4072-b22f-da58ed80862d None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:35.740890 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 315/612] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:35.741684 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba517de-ffc0-4320-b004-c0fdbe2d8b95 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:35.761756 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fa3a5-3dbf-442b-8413-9761cca65f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:35.762399 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fa3a5-3dbf-442b-8413-9761cca65f39 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:35.762681 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fa3a5-3dbf-442b-8413-9761cca65f39 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:35.762954 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fa3a5-3dbf-442b-8413-9761cca65f39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:35.826267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fa3a5-3dbf-442b-8413-9761cca65f39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:35.827674 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fa3a5-3dbf-442b-8413-9761cca65f39 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:35.831318 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba517de-ffc0-4320-b004-c0fdbe2d8b95 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:35.862986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23c937-2b0a-462c-83fd-356aa37e8c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:35.863650 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23c937-2b0a-462c-83fd-356aa37e8c61 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:35.863937 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23c937-2b0a-462c-83fd-356aa37e8c61 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:35.864205 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23c937-2b0a-462c-83fd-356aa37e8c61 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:35.864935 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23c937-2b0a-462c-83fd-356aa37e8c61 None admin] RBAC: Adding query filter params (name=service) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:35.865234 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23c937-2b0a-462c-83fd-356aa37e8c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:35.866591 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23c937-2b0a-462c-83fd-356aa37e8c61 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:35.874037 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 316/613] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 12 16:53:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:35.874815 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23c937-2b0a-462c-83fd-356aa37e8c61 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:35.924353 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 298/614] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:53:35.925214 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fa3a5-3dbf-442b-8413-9761cca65f39 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:35.968993 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23c937-2b0a-462c-83fd-356aa37e8c61 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:36.001082 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1de310-31d0-43a0-b5db-d7fea422b5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:36.001734 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1de310-31d0-43a0-b5db-d7fea422b5b7 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:36.002012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1de310-31d0-43a0-b5db-d7fea422b5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:36.002286 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1de310-31d0-43a0-b5db-d7fea422b5b7 None admin] PATH_INFO: `/v3/projects` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:36.003065 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1de310-31d0-43a0-b5db-d7fea422b5b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:36.003372 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1de310-31d0-43a0-b5db-d7fea422b5b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:36.004844 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1de310-31d0-43a0-b5db-d7fea422b5b7 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:36.016143 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 317/615] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:53:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:36.016948 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1de310-31d0-43a0-b5db-d7fea422b5b7 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:36.017118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fa3a5-3dbf-442b-8413-9761cca65f39 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:36.049209 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1d56c-487c-4e33-8411-e05cb21b6f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:36.050045 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1d56c-487c-4e33-8411-e05cb21b6f7c None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:36.050333 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1d56c-487c-4e33-8411-e05cb21b6f7c None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:36.050618 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1d56c-487c-4e33-8411-e05cb21b6f7c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:36.057432 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1d56c-487c-4e33-8411-e05cb21b6f7c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:36.058866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1d56c-487c-4e33-8411-e05cb21b6f7c None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:36.073481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-f3b1d56c-487c-4e33-8411-e05cb21b6f7c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 16:53:36.073481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:36.073481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:36.073481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:36.073481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:36.073481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:36.073481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:36.073481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:36.073481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:36.073481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:36.073481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:36.073481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:36.073481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:53:36.073481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:53:36.073481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:53:36.073481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:53:36.074522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:36.074522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:36.074522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:53:36.074522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:36.074522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:53:36.074522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:36.074522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:36.074522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:36.074522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:36.074522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:36.074522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:36.074522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:36.074522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:36.074522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:36.074522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:36.074522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:36.074522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:36.074522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:36.075432 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:36.075432 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:36.075432 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:53:36.075432 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:53:36.075432 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:53:36.075432 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:53:36.075432 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:53:36.075432 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:53:36.075432 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 16:53:36.075432 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:36.079185 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 299/616] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:53:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:36.079971 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1d56c-487c-4e33-8411-e05cb21b6f7c None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:36.110534 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1de310-31d0-43a0-b5db-d7fea422b5b7 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:36.142315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff477b0-978f-4ef6-8aa3-461760f65f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:36.143096 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff477b0-978f-4ef6-8aa3-461760f65f66 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:36.143374 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff477b0-978f-4ef6-8aa3-461760f65f66 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:36.143670 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff477b0-978f-4ef6-8aa3-461760f65f66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:36.153097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff477b0-978f-4ef6-8aa3-461760f65f66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:36.154585 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff477b0-978f-4ef6-8aa3-461760f65f66 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:36.171824 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-2ff477b0-978f-4ef6-8aa3-461760f65f66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:36.171824 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:36.171824 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:36.171824 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:36.171824 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:36.171824 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:36.171824 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:36.171824 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:36.171824 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:36.171824 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:36.171824 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:36.171824 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:36.171824 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:36.171824 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:36.171824 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:36.172784 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:36.172784 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:36.172784 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:36.172784 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:36.172784 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:36.172784 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:36.172784 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:36.172784 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:36.172784 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:36.172784 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:36.172784 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:36.172784 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:36.172784 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:36.172784 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:36.172784 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:36.172784 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:36.172784 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:36.173652 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:36.173652 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:36.173652 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:36.173652 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:36.173905 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1d56c-487c-4e33-8411-e05cb21b6f7c None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:36.173987 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 318/617] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:36.173987 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff477b0-978f-4ef6-8aa3-461760f65f66 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:36.208699 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58f3c2-8d3c-494d-89c5-1bfe10f53bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:36.209478 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58f3c2-8d3c-494d-89c5-1bfe10f53bba None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:36.209757 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58f3c2-8d3c-494d-89c5-1bfe10f53bba None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:36.210035 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58f3c2-8d3c-494d-89c5-1bfe10f53bba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:36.220122 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58f3c2-8d3c-494d-89c5-1bfe10f53bba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:36.221560 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58f3c2-8d3c-494d-89c5-1bfe10f53bba None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:36.239146 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-7b58f3c2-8d3c-494d-89c5-1bfe10f53bba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:36.239146 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:36.239146 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:36.239146 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:36.239146 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:36.239146 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:36.239146 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:36.239146 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:36.239146 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:36.239146 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:36.239146 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:36.239146 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:36.239146 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:36.239146 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:36.239146 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:36.240103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:36.240103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:36.240103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:36.240103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:36.240103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:36.240103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:36.240103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:36.240103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:36.240103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:36.240103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:36.240103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:36.240103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:36.240103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:36.240103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:36.240103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:36.240103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:36.240103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:36.240977 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:36.240977 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:36.240977 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:36.240977 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:36.240977 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 300/618] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:36.241253 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58f3c2-8d3c-494d-89c5-1bfe10f53bba None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:36.266184 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff477b0-978f-4ef6-8aa3-461760f65f66 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:36.299189 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e358f-4086-442a-b475-182f7621a1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:36.299872 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e358f-4086-442a-b475-182f7621a1c0 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:36.300155 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e358f-4086-442a-b475-182f7621a1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:36.300433 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e358f-4086-442a-b475-182f7621a1c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:36.301247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e358f-4086-442a-b475-182f7621a1c0 None admin] RBAC: Adding query filter params (role.id=0f1a9958b7874b10b41712760f0b6ffa, scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff, user.id=cd52d2543a9f4b5d9270a12544b0a021) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:36.301557 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e358f-4086-442a-b475-182f7621a1c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:36.303001 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e358f-4086-442a-b475-182f7621a1c0 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:36.308680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 319/619] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:53:36 2022] GET /identity/v3/role_assignments?user.id=cd52d2543a9f4b5d9270a12544b0a021&scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff&role.id=0f1a9958b7874b10b41712760f0b6ffa => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:36.309458 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e358f-4086-442a-b475-182f7621a1c0 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:36.348440 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58f3c2-8d3c-494d-89c5-1bfe10f53bba None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:36.387511 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888dddd-dcb0-4aae-a8d7-fd7aa9ad26d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:36.388243 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888dddd-dcb0-4aae-a8d7-fd7aa9ad26d7 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:36.388527 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888dddd-dcb0-4aae-a8d7-fd7aa9ad26d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:36.388806 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888dddd-dcb0-4aae-a8d7-fd7aa9ad26d7 None admin] PATH_INFO: `/v3/users` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:36.389660 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888dddd-dcb0-4aae-a8d7-fd7aa9ad26d7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:36.389976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888dddd-dcb0-4aae-a8d7-fd7aa9ad26d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:36.391493 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888dddd-dcb0-4aae-a8d7-fd7aa9ad26d7 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:36.410467 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 301/620] 10.222.0.64 () {56 vars in 1137 bytes} [Thu May 12 16:53:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:36.411401 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888dddd-dcb0-4aae-a8d7-fd7aa9ad26d7 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:36.429325 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e358f-4086-442a-b475-182f7621a1c0 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:36.464320 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bfb48-5ed4-46e1-a6a4-8bcca89c0f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:36.464999 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bfb48-5ed4-46e1-a6a4-8bcca89c0f8c None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:36.465283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bfb48-5ed4-46e1-a6a4-8bcca89c0f8c None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:36.465567 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77bfb48-5ed4-46e1-a6a4-8bcca89c0f8c None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:36.466305 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bfb48-5ed4-46e1-a6a4-8bcca89c0f8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:36.467378 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bfb48-5ed4-46e1-a6a4-8bcca89c0f8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:36.468831 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77bfb48-5ed4-46e1-a6a4-8bcca89c0f8c None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:36.481193 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 320/621] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:36.483046 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bfb48-5ed4-46e1-a6a4-8bcca89c0f8c None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:36.530398 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888dddd-dcb0-4aae-a8d7-fd7aa9ad26d7 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:36.569454 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471439f-ff32-4e23-84a2-09f9b7e77af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:36.570123 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471439f-ff32-4e23-84a2-09f9b7e77af8 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:36.570405 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471439f-ff32-4e23-84a2-09f9b7e77af8 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:36.570681 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471439f-ff32-4e23-84a2-09f9b7e77af8 None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:36.571408 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471439f-ff32-4e23-84a2-09f9b7e77af8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:36.571748 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471439f-ff32-4e23-84a2-09f9b7e77af8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:36.573128 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471439f-ff32-4e23-84a2-09f9b7e77af8 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:36.586033 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 302/622] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:36.586881 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471439f-ff32-4e23-84a2-09f9b7e77af8 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:36.597196 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77bfb48-5ed4-46e1-a6a4-8bcca89c0f8c None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:36.631175 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abd72e-8ced-4f02-961c-a924e881cb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:36.631858 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd72e-8ced-4f02-961c-a924e881cb92 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:36.632171 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd72e-8ced-4f02-961c-a924e881cb92 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:36.632419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd72e-8ced-4f02-961c-a924e881cb92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:36.683365 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471439f-ff32-4e23-84a2-09f9b7e77af8 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:36.697411 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abd72e-8ced-4f02-961c-a924e881cb92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:36.698963 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abd72e-8ced-4f02-961c-a924e881cb92 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:36.716534 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecdda1-77b6-4fdd-ad7b-a615f70afedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:36.717908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecdda1-77b6-4fdd-ad7b-a615f70afedb None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:36.718192 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecdda1-77b6-4fdd-ad7b-a615f70afedb None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:36.718468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecdda1-77b6-4fdd-ad7b-a615f70afedb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:36.727143 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecdda1-77b6-4fdd-ad7b-a615f70afedb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:36.728827 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ecdda1-77b6-4fdd-ad7b-a615f70afedb None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:36.742845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-b6ecdda1-77b6-4fdd-ad7b-a615f70afedb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 16:53:36.742845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:36.742845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:36.742845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:36.742845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:36.742845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:36.742845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:36.742845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:36.742845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:36.742845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:36.742845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:36.742845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:36.742845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:53:36.742845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:53:36.742845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:53:36.742845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:53:36.744058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:36.744058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:36.744058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:53:36.744058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:36.744058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:53:36.744058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:36.744058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:36.744058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:36.744058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:36.744058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:36.744058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:36.744058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:36.744058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:36.744058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:36.744058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:36.744058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:36.744058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:36.744058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:36.744989 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:36.744989 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:36.744989 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:53:36.744989 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:53:36.744989 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:53:36.744989 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:53:36.744989 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:53:36.744989 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:53:36.744989 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 16:53:36.744989 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:36.748196 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 303/623] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 12 16:53:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:36.749283 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecdda1-77b6-4fdd-ad7b-a615f70afedb None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:36.799477 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 321/624] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:53:36.800360 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abd72e-8ced-4f02-961c-a924e881cb92 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:36.849385 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecdda1-77b6-4fdd-ad7b-a615f70afedb None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:36.893268 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cca154-95f8-4be8-b927-3fffaaa21394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:36.893988 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca154-95f8-4be8-b927-3fffaaa21394 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:36.894270 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca154-95f8-4be8-b927-3fffaaa21394 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:36.894545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca154-95f8-4be8-b927-3fffaaa21394 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:36.902572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cca154-95f8-4be8-b927-3fffaaa21394 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:36.905859 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cca154-95f8-4be8-b927-3fffaaa21394 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:36.913768 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abd72e-8ced-4f02-961c-a924e881cb92 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:36.924641 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-d6cca154-95f8-4be8-b927-3fffaaa21394 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:36.924641 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:36.924641 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:36.924641 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:36.924641 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:36.924641 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:36.924641 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:36.924641 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:36.924641 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:36.924641 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:36.924641 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:36.924641 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:36.924641 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:53:36.924641 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:53:36.924641 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:53:36.925572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:53:36.925572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:36.925572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:36.925572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:36.925572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:36.925572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:36.925572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:36.925572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:36.925572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:36.925572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:36.925572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:36.925572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:36.925572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:36.925572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:36.925572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:36.925572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:36.925572 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:36.926437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:53:36.926437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:53:36.926437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:53:36.926437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:53:36.926437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:53:36.926437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:53:36.926437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:36.926437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:36.927925 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 304/625] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:36.929104 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cca154-95f8-4be8-b927-3fffaaa21394 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:36.952326 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7219412-ed9f-4328-9552-658e74104ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:36.952997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7219412-ed9f-4328-9552-658e74104ed2 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:36.953295 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7219412-ed9f-4328-9552-658e74104ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:36.953553 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7219412-ed9f-4328-9552-658e74104ed2 None admin] PATH_INFO: `/v3/users` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:36.958288 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7219412-ed9f-4328-9552-658e74104ed2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:36.958288 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7219412-ed9f-4328-9552-658e74104ed2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:36.958288 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7219412-ed9f-4328-9552-658e74104ed2 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:36.977034 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 322/626] 10.222.0.64 () {56 vars in 1139 bytes} [Thu May 12 16:53:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:36.977858 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7219412-ed9f-4328-9552-658e74104ed2 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:37.049302 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cca154-95f8-4be8-b927-3fffaaa21394 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:37.077136 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7219412-ed9f-4328-9552-658e74104ed2 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:37.081486 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f78e8-c30e-4cf0-92a7-4d85c8ebc8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:37.082277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f78e8-c30e-4cf0-92a7-4d85c8ebc8f1 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:37.082562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f78e8-c30e-4cf0-92a7-4d85c8ebc8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:37.082842 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f78e8-c30e-4cf0-92a7-4d85c8ebc8f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:37.093232 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f78e8-c30e-4cf0-92a7-4d85c8ebc8f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:37.094692 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f78e8-c30e-4cf0-92a7-4d85c8ebc8f1 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:37.109570 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7384f67-6ee8-4ae5-98ee-42ec63be4273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:37.110222 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7384f67-6ee8-4ae5-98ee-42ec63be4273 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:37.110503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7384f67-6ee8-4ae5-98ee-42ec63be4273 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:37.110774 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7384f67-6ee8-4ae5-98ee-42ec63be4273 None admin] PATH_INFO: `/v3/projects` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:37.111545 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7384f67-6ee8-4ae5-98ee-42ec63be4273 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:37.111871 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7384f67-6ee8-4ae5-98ee-42ec63be4273 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:37.112655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-a41f78e8-c30e-4cf0-92a7-4d85c8ebc8f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:37.112655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:37.112655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:37.112655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:37.112655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:37.112655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:37.112655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:37.112655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:37.112655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:37.112655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:37.112655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:37.112655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:37.112655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:37.112655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:37.112655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:37.113485 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:37.113485 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:37.113485 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:37.113485 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:37.113485 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:37.113485 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:37.113485 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:37.113485 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:37.113485 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:37.113485 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:37.113485 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:37.113485 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:37.113485 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:37.113485 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:37.113485 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:37.113485 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:37.113485 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:37.114365 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:37.114365 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:37.114365 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:37.114365 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:37.114580 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7384f67-6ee8-4ae5-98ee-42ec63be4273 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:37.114661 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 305/627] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:37.115116 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f78e8-c30e-4cf0-92a7-4d85c8ebc8f1 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:37.134619 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 323/628] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:53:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:37.134619 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7384f67-6ee8-4ae5-98ee-42ec63be4273 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:37.224321 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f78e8-c30e-4cf0-92a7-4d85c8ebc8f1 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:37.227775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7384f67-6ee8-4ae5-98ee-42ec63be4273 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:37.265171 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c1c9e-3e61-4f27-82fc-b340519b180e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:37.268488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659c5bb-6c17-4d36-8589-a8ed4d33ec0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:37.269148 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659c5bb-6c17-4d36-8589-a8ed4d33ec0c None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:37.269423 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659c5bb-6c17-4d36-8589-a8ed4d33ec0c None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:37.269712 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659c5bb-6c17-4d36-8589-a8ed4d33ec0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:37.275044 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c1c9e-3e61-4f27-82fc-b340519b180e None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:37.276044 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c1c9e-3e61-4f27-82fc-b340519b180e None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:37.276327 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c1c9e-3e61-4f27-82fc-b340519b180e None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:37.277087 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c1c9e-3e61-4f27-82fc-b340519b180e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:37.277396 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c1c9e-3e61-4f27-82fc-b340519b180e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:37.278798 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c1c9e-3e61-4f27-82fc-b340519b180e None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:37.296266 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 324/629] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:37.297415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c1c9e-3e61-4f27-82fc-b340519b180e None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:37.346980 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659c5bb-6c17-4d36-8589-a8ed4d33ec0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:37.348887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659c5bb-6c17-4d36-8589-a8ed4d33ec0c None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:37.401821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c1c9e-3e61-4f27-82fc-b340519b180e None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:37.437571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7be5f5-d9a8-455d-b72f-f87674d7f628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:37.438562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7be5f5-d9a8-455d-b72f-f87674d7f628 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:37.439300 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7be5f5-d9a8-455d-b72f-f87674d7f628 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:37.439881 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7be5f5-d9a8-455d-b72f-f87674d7f628 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:37.441056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7be5f5-d9a8-455d-b72f-f87674d7f628 None admin] RBAC: Adding query filter params (role.id=0f1a9958b7874b10b41712760f0b6ffa, scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff, user.id=deb66d4bda564438852a38a4a4116ccb) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:37.441602 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7be5f5-d9a8-455d-b72f-f87674d7f628 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:37.443270 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7be5f5-d9a8-455d-b72f-f87674d7f628 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:37.448131 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 306/630] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:53:37.448981 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659c5bb-6c17-4d36-8589-a8ed4d33ec0c None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:37.450057 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 325/631] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:53:37 2022] GET /identity/v3/role_assignments?user.id=deb66d4bda564438852a38a4a4116ccb&scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff&role.id=0f1a9958b7874b10b41712760f0b6ffa => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:37.454202 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7be5f5-d9a8-455d-b72f-f87674d7f628 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:37.564456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659c5bb-6c17-4d36-8589-a8ed4d33ec0c None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:37.565227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7be5f5-d9a8-455d-b72f-f87674d7f628 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:37.606029 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1b432-486b-4d34-83ff-6b40e1170e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:37.613513 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1b432-486b-4d34-83ff-6b40e1170e15 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:37.613513 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1b432-486b-4d34-83ff-6b40e1170e15 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:37.613513 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1b432-486b-4d34-83ff-6b40e1170e15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:37.616763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1b432-486b-4d34-83ff-6b40e1170e15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:37.619475 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1b432-486b-4d34-83ff-6b40e1170e15 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:37.632035 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c93ab8-ce57-46e6-91f8-bebc2ef7c826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:37.633611 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c93ab8-ce57-46e6-91f8-bebc2ef7c826 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:37.634117 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c93ab8-ce57-46e6-91f8-bebc2ef7c826 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:37.634601 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c93ab8-ce57-46e6-91f8-bebc2ef7c826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:37.638224 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-87d1b432-486b-4d34-83ff-6b40e1170e15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:37.638224 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:37.638224 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:37.638224 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:37.638224 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:37.638224 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:37.638224 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:37.638224 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:37.638224 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:37.638224 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:37.638224 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:37.638224 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:37.638224 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:53:37.638224 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:53:37.638224 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:53:37.639609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:53:37.639609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:37.639609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:37.639609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:37.639609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:37.639609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:37.639609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:37.639609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:37.639609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:37.639609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:37.639609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:37.639609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:37.639609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:37.639609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:37.639609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:37.639609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:37.639609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:37.640669 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:53:37.640669 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:53:37.640669 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:53:37.640669 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:53:37.640669 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:53:37.640669 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:53:37.640669 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:37.640669 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:37.640669 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 307/632] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:37.646941 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1b432-486b-4d34-83ff-6b40e1170e15 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:37.648478 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c93ab8-ce57-46e6-91f8-bebc2ef7c826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:37.650391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c93ab8-ce57-46e6-91f8-bebc2ef7c826 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:37.672902 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-01c93ab8-ce57-46e6-91f8-bebc2ef7c826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:37.672902 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:37.672902 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:37.672902 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:37.672902 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:37.672902 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:37.672902 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:37.672902 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:37.672902 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:37.672902 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:37.672902 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:37.672902 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:37.672902 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:37.672902 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:37.672902 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:37.674246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:37.674246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:37.674246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:37.674246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:37.674246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:37.674246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:37.674246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:37.674246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:37.674246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:37.674246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:37.674246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:37.674246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:37.674246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:37.674246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:37.674246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:37.674246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:37.674246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:37.675119 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:37.675119 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:37.675119 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:37.675119 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:37.675119 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 326/633] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:37.679377 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c93ab8-ce57-46e6-91f8-bebc2ef7c826 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:37.770716 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1b432-486b-4d34-83ff-6b40e1170e15 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:37.802587 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c93ab8-ce57-46e6-91f8-bebc2ef7c826 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:37.813929 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad1c02-39fc-4d68-84c7-7d85b2089e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:37.815109 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad1c02-39fc-4d68-84c7-7d85b2089e49 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:37.815540 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad1c02-39fc-4d68-84c7-7d85b2089e49 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:37.816224 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad1c02-39fc-4d68-84c7-7d85b2089e49 None admin] PATH_INFO: `/v3/projects` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:37.817668 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad1c02-39fc-4d68-84c7-7d85b2089e49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:37.818227 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad1c02-39fc-4d68-84c7-7d85b2089e49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:37.820357 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad1c02-39fc-4d68-84c7-7d85b2089e49 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:37.836133 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 308/634] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:53:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:37.842165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad1c02-39fc-4d68-84c7-7d85b2089e49 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:37.844856 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8a3a6-f8b8-415e-9a08-7b482f20f23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:37.845525 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8a3a6-f8b8-415e-9a08-7b482f20f23a None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:37.846011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8a3a6-f8b8-415e-9a08-7b482f20f23a None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:37.846293 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8a3a6-f8b8-415e-9a08-7b482f20f23a None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:37.847018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8a3a6-f8b8-415e-9a08-7b482f20f23a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:37.848217 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8a3a6-f8b8-415e-9a08-7b482f20f23a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:37.849609 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca8a3a6-f8b8-415e-9a08-7b482f20f23a None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:37.865246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 327/635] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:37.870335 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8a3a6-f8b8-415e-9a08-7b482f20f23a None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:37.969776 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad1c02-39fc-4d68-84c7-7d85b2089e49 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:38.013299 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65dfb2-6341-45cd-ad7c-e30501906854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:38.014815 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65dfb2-6341-45cd-ad7c-e30501906854 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:38.015191 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65dfb2-6341-45cd-ad7c-e30501906854 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:38.015559 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65dfb2-6341-45cd-ad7c-e30501906854 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:38.016498 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65dfb2-6341-45cd-ad7c-e30501906854 None admin] RBAC: Adding query filter params (role.id=0f1a9958b7874b10b41712760f0b6ffa, scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff, user.id=83541095ea5646038feef0764f0473c0) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:38.016902 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65dfb2-6341-45cd-ad7c-e30501906854 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:38.018129 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8a3a6-f8b8-415e-9a08-7b482f20f23a None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:38.018556 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65dfb2-6341-45cd-ad7c-e30501906854 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:38.031671 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 309/636] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:53:37 2022] GET /identity/v3/role_assignments?user.id=83541095ea5646038feef0764f0473c0&scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff&role.id=0f1a9958b7874b10b41712760f0b6ffa => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:38.056568 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bb3fa-40d1-46de-8289-75180b6eb2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:38.057542 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bb3fa-40d1-46de-8289-75180b6eb2a6 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:38.057825 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bb3fa-40d1-46de-8289-75180b6eb2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:38.058099 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bb3fa-40d1-46de-8289-75180b6eb2a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:38.066450 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bb3fa-40d1-46de-8289-75180b6eb2a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:38.067923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bb3fa-40d1-46de-8289-75180b6eb2a6 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:38.083344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-767bb3fa-40d1-46de-8289-75180b6eb2a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:38.083344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:38.083344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:38.083344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:38.083344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:38.083344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:38.083344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:38.083344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:38.083344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:38.083344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:38.083344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:38.083344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:38.083344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:53:38.083344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:53:38.083344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:53:38.084329 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:53:38.084329 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:38.084329 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:38.084329 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:38.084329 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:38.084329 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:38.084329 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:38.084329 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:38.084329 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:38.084329 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:38.084329 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:38.084329 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:38.084329 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:38.084329 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:38.084329 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:38.084329 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:38.084329 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:38.085180 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:53:38.085180 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:53:38.085180 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:53:38.085180 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:53:38.085180 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:53:38.085180 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:53:38.085180 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:38.085180 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:38.085180 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 328/637] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:53:38.090640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65dfb2-6341-45cd-ad7c-e30501906854 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:38.199333 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65dfb2-6341-45cd-ad7c-e30501906854 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:38.235060 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3699fb-1326-4aa4-8957-1b85e83337ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:38.235750 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3699fb-1326-4aa4-8957-1b85e83337ce None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:38.236033 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3699fb-1326-4aa4-8957-1b85e83337ce None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:38.236305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3699fb-1326-4aa4-8957-1b85e83337ce None admin] PATH_INFO: `/v3/projects` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:38.237091 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3699fb-1326-4aa4-8957-1b85e83337ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:38.237398 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3699fb-1326-4aa4-8957-1b85e83337ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:38.238818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3699fb-1326-4aa4-8957-1b85e83337ce None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:38.251874 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 310/638] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:53:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:38.257509 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bb3fa-40d1-46de-8289-75180b6eb2a6 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:38.359247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bb3fa-40d1-46de-8289-75180b6eb2a6 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:38.392445 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce0980-aaff-495d-b3cb-a28c9751ed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:38.393094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce0980-aaff-495d-b3cb-a28c9751ed33 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:38.393371 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce0980-aaff-495d-b3cb-a28c9751ed33 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:38.393640 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce0980-aaff-495d-b3cb-a28c9751ed33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:38.394462 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce0980-aaff-495d-b3cb-a28c9751ed33 None admin] RBAC: Adding query filter params (role.id=0f1a9958b7874b10b41712760f0b6ffa, scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff, user.id=b2cc0957b3e2402b8e6f47d46bfa02be) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:38.394768 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce0980-aaff-495d-b3cb-a28c9751ed33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:38.396249 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce0980-aaff-495d-b3cb-a28c9751ed33 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:38.402310 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 329/639] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:53:38 2022] GET /identity/v3/role_assignments?user.id=b2cc0957b3e2402b8e6f47d46bfa02be&scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff&role.id=0f1a9958b7874b10b41712760f0b6ffa => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:38.728268 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e31846-828b-4431-a8b2-50b6a7160aa6 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:38.728844 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e31846-828b-4431-a8b2-50b6a7160aa6 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:38.728844 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e31846-828b-4431-a8b2-50b6a7160aa6 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:38.730618 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 311/640] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:38.737177 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a0032-9e89-4533-8fe4-c6b1840b195c None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:38.737700 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a0032-9e89-4533-8fe4-c6b1840b195c None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:38.737775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a0032-9e89-4533-8fe4-c6b1840b195c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:38.756021 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-123a0032-9e89-4533-8fe4-c6b1840b195c None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:38.757206 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-123a0032-9e89-4533-8fe4-c6b1840b195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:38.828007 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 330/641] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:38.848476 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e31846-828b-4431-a8b2-50b6a7160aa6 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:38.951505 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e31846-828b-4431-a8b2-50b6a7160aa6 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:38.986070 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dfe8d-9f1f-4beb-b47a-b1abe98c4f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:38.986785 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dfe8d-9f1f-4beb-b47a-b1abe98c4f59 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:38.987065 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dfe8d-9f1f-4beb-b47a-b1abe98c4f59 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:38.987340 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dfe8d-9f1f-4beb-b47a-b1abe98c4f59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:38.997774 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2dfe8d-9f1f-4beb-b47a-b1abe98c4f59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:39.005375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-be2dfe8d-9f1f-4beb-b47a-b1abe98c4f59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:53:39.005375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:39.005375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:39.005375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:39.005375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:39.005375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:39.005375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:39.005375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:39.005375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:39.005375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:39.005375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:39.005375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:39.005375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:39.005375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:39.005375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:39.005375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:39.007614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:39.007614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:39.007614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:39.007614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:39.007614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:39.007614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:39.007614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:39.007614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:39.007614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:39.007614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:39.007614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:39.007614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:39.007614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:39.007614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:39.007614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:39.007614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:39.009763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:39.009763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:39.009763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:39.009763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:39.009763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:39.009763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:39.009763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:39.009763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:39.009763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:39.009763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:39.009763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:53:39.009763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:39.011411 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 312/642] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 12 16:53:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:39.015668 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a0032-9e89-4533-8fe4-c6b1840b195c None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:39.110013 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a0032-9e89-4533-8fe4-c6b1840b195c None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:39.143227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44788e2-602c-437d-b45d-67729ca29b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:39.143927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44788e2-602c-437d-b45d-67729ca29b27 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:39.144208 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44788e2-602c-437d-b45d-67729ca29b27 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:39.144485 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44788e2-602c-437d-b45d-67729ca29b27 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:39.145232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44788e2-602c-437d-b45d-67729ca29b27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:39.145538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44788e2-602c-437d-b45d-67729ca29b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:39.146918 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44788e2-602c-437d-b45d-67729ca29b27 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:39.159488 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 331/643] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:53:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:39.160957 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dfe8d-9f1f-4beb-b47a-b1abe98c4f59 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:39.266992 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dfe8d-9f1f-4beb-b47a-b1abe98c4f59 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:39.301156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0253600-c039-4612-80e4-4889aeb9d193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:39.302283 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0253600-c039-4612-80e4-4889aeb9d193 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:39.302750 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0253600-c039-4612-80e4-4889aeb9d193 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:39.303233 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0253600-c039-4612-80e4-4889aeb9d193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:39.316465 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0253600-c039-4612-80e4-4889aeb9d193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:39.318251 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0253600-c039-4612-80e4-4889aeb9d193 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:39.336875 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-f0253600-c039-4612-80e4-4889aeb9d193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:39.336875 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:39.336875 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:39.336875 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:39.336875 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:39.336875 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:39.336875 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:39.336875 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:39.336875 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:39.336875 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:39.336875 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:39.336875 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:39.336875 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:39.336875 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:39.336875 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:39.337778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:39.337778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:39.337778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:39.337778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:39.337778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:39.337778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:39.337778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:39.337778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:39.337778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:39.337778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:39.337778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:39.337778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:39.337778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:39.337778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:39.337778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:39.337778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:39.337778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:39.338640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:39.338640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:39.338640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:39.338640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:39.344877 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 313/644] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:39.346394 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44788e2-602c-437d-b45d-67729ca29b27 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:39.453485 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44788e2-602c-437d-b45d-67729ca29b27 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:39.487036 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46356b2-317b-42aa-b3a6-1946643c970b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:39.487778 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46356b2-317b-42aa-b3a6-1946643c970b None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:39.488072 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46356b2-317b-42aa-b3a6-1946643c970b None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:39.488347 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46356b2-317b-42aa-b3a6-1946643c970b None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:39.489068 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46356b2-317b-42aa-b3a6-1946643c970b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:39.489376 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46356b2-317b-42aa-b3a6-1946643c970b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:39.490806 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46356b2-317b-42aa-b3a6-1946643c970b None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:39.503309 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 332/645] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:39.508740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0253600-c039-4612-80e4-4889aeb9d193 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:39.611164 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0253600-c039-4612-80e4-4889aeb9d193 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:39.646633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d4ae3-ace8-435a-bb67-c1929e1153dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:39.647818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d4ae3-ace8-435a-bb67-c1929e1153dd None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:39.648333 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d4ae3-ace8-435a-bb67-c1929e1153dd None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:39.648806 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d4ae3-ace8-435a-bb67-c1929e1153dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:39.656630 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d4ae3-ace8-435a-bb67-c1929e1153dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:39.658306 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d4ae3-ace8-435a-bb67-c1929e1153dd None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:39.672967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-968d4ae3-ace8-435a-bb67-c1929e1153dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 16:53:39.672967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:39.672967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:39.672967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:39.672967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:39.672967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:39.672967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:39.672967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:39.672967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:39.672967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:39.672967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:39.672967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:39.672967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:53:39.672967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:53:39.672967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:53:39.672967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:53:39.673908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:39.673908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:39.673908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:53:39.673908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:39.673908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:53:39.673908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:39.673908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:39.673908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:39.673908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:39.673908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:39.673908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:39.673908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:39.673908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:39.673908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:39.673908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:39.673908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:39.673908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:39.673908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:39.674830 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:39.674830 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:39.674830 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:53:39.674830 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:53:39.674830 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:53:39.674830 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:53:39.674830 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:53:39.674830 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:53:39.674830 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 16:53:39.674830 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:39.681579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 314/646] 10.222.0.64 () {56 vars in 1093 bytes} [Thu May 12 16:53:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:39.683145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46356b2-317b-42aa-b3a6-1946643c970b None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:39.787355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46356b2-317b-42aa-b3a6-1946643c970b None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:39.822945 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db6e7f-d521-4ee9-bd5d-daec3a9ddd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:39.824017 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db6e7f-d521-4ee9-bd5d-daec3a9ddd5e None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:39.824529 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db6e7f-d521-4ee9-bd5d-daec3a9ddd5e None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:39.825003 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db6e7f-d521-4ee9-bd5d-daec3a9ddd5e None admin] PATH_INFO: `/v3/users` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:39.826184 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db6e7f-d521-4ee9-bd5d-daec3a9ddd5e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:39.826705 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db6e7f-d521-4ee9-bd5d-daec3a9ddd5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:39.828494 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db6e7f-d521-4ee9-bd5d-daec3a9ddd5e None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:39.850475 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 333/647] 10.222.0.64 () {56 vars in 1133 bytes} [Thu May 12 16:53:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:39.852391 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d4ae3-ace8-435a-bb67-c1929e1153dd None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:39.938668 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e09ee-956b-4b0b-aae7-558e118e8a22 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:39.939015 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e09ee-956b-4b0b-aae7-558e118e8a22 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:39.939219 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e09ee-956b-4b0b-aae7-558e118e8a22 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:39.941043 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 334/648] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:53:39.946287 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75b77b-7f7c-4564-a38d-074afbddd2e5 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:39.946287 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75b77b-7f7c-4564-a38d-074afbddd2e5 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:39.946637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75b77b-7f7c-4564-a38d-074afbddd2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:39.959182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d4ae3-ace8-435a-bb67-c1929e1153dd None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:39.963368 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-ec75b77b-7f7c-4564-a38d-074afbddd2e5 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:39.964571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-ec75b77b-7f7c-4564-a38d-074afbddd2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:39.994938 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208c081-90c2-425b-933b-b49400e98556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:39.995996 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208c081-90c2-425b-933b-b49400e98556 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:39.996486 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208c081-90c2-425b-933b-b49400e98556 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:39.996962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208c081-90c2-425b-933b-b49400e98556 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:40.039745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 335/649] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:53:40.057724 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75b77b-7f7c-4564-a38d-074afbddd2e5 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:40.067994 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208c081-90c2-425b-933b-b49400e98556 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:40.069800 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208c081-90c2-425b-933b-b49400e98556 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:40.157093 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75b77b-7f7c-4564-a38d-074afbddd2e5 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:40.171900 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 315/650] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 16:53:40.177384 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208c081-90c2-425b-933b-b49400e98556 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:40.197676 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a114b8-d5c1-457b-8dda-24fe7c0a6ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:40.198475 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a114b8-d5c1-457b-8dda-24fe7c0a6ddc None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:40.198757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a114b8-d5c1-457b-8dda-24fe7c0a6ddc None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:40.199035 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a114b8-d5c1-457b-8dda-24fe7c0a6ddc None admin] PATH_INFO: `/v3/services/image` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:40.199714 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a114b8-d5c1-457b-8dda-24fe7c0a6ddc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:40.201919 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a114b8-d5c1-457b-8dda-24fe7c0a6ddc None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:40.215313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-00a114b8-d5c1-457b-8dda-24fe7c0a6ddc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 16:53:40.215313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:40.215313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:53:40.215313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:53:40.215313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:53:40.215313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:53:40.215313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:53:40.215313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:40.215313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 16:53:40.215313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:40.215313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:53:40.215313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:40.215313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:40.215313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:40.215313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:40.215313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:40.215313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:40.216440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:40.216440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:40.216440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:40.216440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:40.216440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:40.216440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:40.216440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:53:40.216440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:53:40.216440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:53:40.216440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:53:40.216440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:40.216440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:40.216440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:40.216440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:40.216440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:40.216440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:40.217332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:40.217332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:40.217332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:40.217332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:40.217332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:40.217332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:40.217332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:40.217332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:40.217332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:40.217332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:40.217332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:53:40.217332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:40.217332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 16:53:40.217332 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:40.221489 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 336/651] 10.222.0.64 () {56 vars in 1105 bytes} [Thu May 12 16:53:40 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:53:40.222827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a114b8-d5c1-457b-8dda-24fe7c0a6ddc None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:40.285092 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208c081-90c2-425b-933b-b49400e98556 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:40.332385 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a114b8-d5c1-457b-8dda-24fe7c0a6ddc None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:40.337308 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457ad57-4d54-4f67-9821-cc8666f2ae91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:40.338504 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457ad57-4d54-4f67-9821-cc8666f2ae91 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:40.338989 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457ad57-4d54-4f67-9821-cc8666f2ae91 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:40.339504 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457ad57-4d54-4f67-9821-cc8666f2ae91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:40.352006 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457ad57-4d54-4f67-9821-cc8666f2ae91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:40.353894 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457ad57-4d54-4f67-9821-cc8666f2ae91 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:40.371287 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d543b1-6d2f-46da-bacc-a5eb931ec2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:40.371990 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d543b1-6d2f-46da-bacc-a5eb931ec2dc None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:40.372274 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d543b1-6d2f-46da-bacc-a5eb931ec2dc None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:40.373146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d543b1-6d2f-46da-bacc-a5eb931ec2dc None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:40.373802 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d543b1-6d2f-46da-bacc-a5eb931ec2dc None admin] RBAC: Adding query filter params (name=image) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:40.374113 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d543b1-6d2f-46da-bacc-a5eb931ec2dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:40.375503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d543b1-6d2f-46da-bacc-a5eb931ec2dc None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:40.376221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-8457ad57-4d54-4f67-9821-cc8666f2ae91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:40.376221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:40.376221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:40.376221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:40.376221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:40.376221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:40.376221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:40.376221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:40.376221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:40.376221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:40.376221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:40.376221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:40.376221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:40.376221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:40.376221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:40.377057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:40.377057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:40.377057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:40.377057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:40.377057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:40.377057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:40.377057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:40.377057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:40.377057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:40.377057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:40.377057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:40.377057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:40.377057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:40.377057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:40.377057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:40.377057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:40.377057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:40.377942 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:40.377942 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:40.377942 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:40.377942 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:40.380142 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 316/652] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:40.384106 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 337/653] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:40.385477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457ad57-4d54-4f67-9821-cc8666f2ae91 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:40.389878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d543b1-6d2f-46da-bacc-a5eb931ec2dc None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:40.488857 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457ad57-4d54-4f67-9821-cc8666f2ae91 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:40.493129 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d543b1-6d2f-46da-bacc-a5eb931ec2dc None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:40.525227 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75448c90-4b50-477d-add4-0afa425a9e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:40.525901 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75448c90-4b50-477d-add4-0afa425a9e75 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:40.526179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75448c90-4b50-477d-add4-0afa425a9e75 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:40.526450 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75448c90-4b50-477d-add4-0afa425a9e75 None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:40.527170 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75448c90-4b50-477d-add4-0afa425a9e75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:40.527473 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75448c90-4b50-477d-add4-0afa425a9e75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:40.528958 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75448c90-4b50-477d-add4-0afa425a9e75 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:40.533040 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32d78a-e582-40dd-8686-649210ff9dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:40.533740 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32d78a-e582-40dd-8686-649210ff9dc1 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:40.533996 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32d78a-e582-40dd-8686-649210ff9dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:40.534270 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32d78a-e582-40dd-8686-649210ff9dc1 None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:40.534977 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32d78a-e582-40dd-8686-649210ff9dc1 None admin] RBAC: Adding query filter params (type=image) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:40.535283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32d78a-e582-40dd-8686-649210ff9dc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:40.536702 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32d78a-e582-40dd-8686-649210ff9dc1 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:40.547838 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 338/654] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:40.547838 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235e0ba-9fa3-468e-a8e1-dc9148a19e76 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:40.547838 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235e0ba-9fa3-468e-a8e1-dc9148a19e76 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:40.547838 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235e0ba-9fa3-468e-a8e1-dc9148a19e76 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:40.548221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 317/655] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:40.549070 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75448c90-4b50-477d-add4-0afa425a9e75 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:40.550509 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 339/656] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:40.552087 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a27d5-6bdb-4fda-82eb-b5d6b65a62f9 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:40.552498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a27d5-6bdb-4fda-82eb-b5d6b65a62f9 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:40.552662 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a27d5-6bdb-4fda-82eb-b5d6b65a62f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:40.571598 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-312a27d5-6bdb-4fda-82eb-b5d6b65a62f9 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:40.572860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-312a27d5-6bdb-4fda-82eb-b5d6b65a62f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:40.664065 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75448c90-4b50-477d-add4-0afa425a9e75 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:40.671590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 340/657] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:40.695669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a27d5-6bdb-4fda-82eb-b5d6b65a62f9 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:40.715264 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544fb7b-d7a0-4784-9065-4acb91ba7d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:40.717261 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544fb7b-d7a0-4784-9065-4acb91ba7d04 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:40.717780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544fb7b-d7a0-4784-9065-4acb91ba7d04 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:40.718315 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544fb7b-d7a0-4784-9065-4acb91ba7d04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:40.730813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544fb7b-d7a0-4784-9065-4acb91ba7d04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:40.733533 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544fb7b-d7a0-4784-9065-4acb91ba7d04 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:40.755558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-d544fb7b-d7a0-4784-9065-4acb91ba7d04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:40.755558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:40.755558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:40.755558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:40.755558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:40.755558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:40.755558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:40.755558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:40.755558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:40.755558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:40.755558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:40.755558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:40.755558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:53:40.755558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:53:40.755558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:53:40.756549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:53:40.756549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:40.756549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:40.756549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:40.756549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:40.756549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:40.756549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:40.756549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:40.756549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:40.756549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:40.756549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:40.756549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:40.756549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:40.756549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:40.756549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:40.756549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:40.756549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:40.757471 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:53:40.757471 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:53:40.757471 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:53:40.757471 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:53:40.757471 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:53:40.757471 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:53:40.757471 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:40.757471 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:40.760226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 318/658] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:40.768162 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544fb7b-d7a0-4784-9065-4acb91ba7d04 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:40.818999 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a27d5-6bdb-4fda-82eb-b5d6b65a62f9 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:40.854278 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a53a3-732d-443e-be3a-bf6057ab0aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:40.854981 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a53a3-732d-443e-be3a-bf6057ab0aeb None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:40.855274 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a53a3-732d-443e-be3a-bf6057ab0aeb None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:40.855547 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a53a3-732d-443e-be3a-bf6057ab0aeb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:40.856265 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a53a3-732d-443e-be3a-bf6057ab0aeb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:40.858596 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a53a3-732d-443e-be3a-bf6057ab0aeb None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:40.870275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-4c9a53a3-732d-443e-be3a-bf6057ab0aeb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 16:53:40.870275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:40.870275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:53:40.870275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:53:40.870275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:53:40.870275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:53:40.870275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:53:40.870275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:40.870275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 16:53:40.870275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:40.870275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:53:40.870275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:40.870275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:40.870275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:40.870275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:40.870275 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:40.871210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:40.871210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:40.871210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:40.871210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:40.871210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:40.871210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:40.871210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:40.871210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:53:40.871210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:53:40.871210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:53:40.871210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:53:40.871210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:40.871210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:40.871210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:40.871210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:40.871210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:40.872425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:40.872425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:40.872425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:40.872425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:40.872425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:40.872425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:40.872425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:40.872425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:40.872425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:40.872425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:40.872425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:40.872425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:53:40.872425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:40.872425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 16:53:40.872425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:40.872425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 341/659] 10.222.0.64 () {56 vars in 1129 bytes} [Thu May 12 16:53:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:53:40.873243 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a979b92-2eba-4431-b7b5-7dfc7c357658 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:40.873243 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a979b92-2eba-4431-b7b5-7dfc7c357658 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:40.873371 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a979b92-2eba-4431-b7b5-7dfc7c357658 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:40.875680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 342/660] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:40.877113 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a979b92-2eba-4431-b7b5-7dfc7c357658 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:40.895223 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544fb7b-d7a0-4784-9065-4acb91ba7d04 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:40.932671 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a54fc2-b33c-421b-ad2c-2412a231b57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:40.933339 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a54fc2-b33c-421b-ad2c-2412a231b57a None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:40.933622 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a54fc2-b33c-421b-ad2c-2412a231b57a None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:40.933900 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a54fc2-b33c-421b-ad2c-2412a231b57a None admin] PATH_INFO: `/v3/projects` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:40.934683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a54fc2-b33c-421b-ad2c-2412a231b57a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:40.935035 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a54fc2-b33c-421b-ad2c-2412a231b57a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:40.936526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a54fc2-b33c-421b-ad2c-2412a231b57a None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:40.952916 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 319/661] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:53:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:40.952916 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edfb3a-4e68-4853-ad9a-4b933fb66a5a None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:40.952916 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edfb3a-4e68-4853-ad9a-4b933fb66a5a None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:40.952916 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edfb3a-4e68-4853-ad9a-4b933fb66a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:40.968910 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-98edfb3a-4e68-4853-ad9a-4b933fb66a5a None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:40.970103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-98edfb3a-4e68-4853-ad9a-4b933fb66a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:40.988932 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a979b92-2eba-4431-b7b5-7dfc7c357658 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:41.021796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a6c70-6bf5-47f7-b249-97180cfc9626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:41.022516 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a6c70-6bf5-47f7-b249-97180cfc9626 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:41.022898 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a6c70-6bf5-47f7-b249-97180cfc9626 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:41.023294 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a6c70-6bf5-47f7-b249-97180cfc9626 None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:41.024148 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a6c70-6bf5-47f7-b249-97180cfc9626 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:41.024557 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a6c70-6bf5-47f7-b249-97180cfc9626 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:41.026041 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a6c70-6bf5-47f7-b249-97180cfc9626 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:41.035365 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 343/662] 10.222.0.64 () {56 vars in 1124 bytes} [Thu May 12 16:53:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:41.035365 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a6c70-6bf5-47f7-b249-97180cfc9626 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:41.040269 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 320/663] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:41.040970 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edfb3a-4e68-4853-ad9a-4b933fb66a5a None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:41.144159 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edfb3a-4e68-4853-ad9a-4b933fb66a5a None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:41.146221 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a6c70-6bf5-47f7-b249-97180cfc9626 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:41.177258 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef1fb2-c8db-4218-be98-68082e345a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:41.177922 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef1fb2-c8db-4218-be98-68082e345a16 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:41.178028 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24447dd6-d84f-4a59-8878-2186321968f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:41.178233 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef1fb2-c8db-4218-be98-68082e345a16 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:41.178473 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef1fb2-c8db-4218-be98-68082e345a16 None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:41.178632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24447dd6-d84f-4a59-8878-2186321968f1 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:41.178875 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24447dd6-d84f-4a59-8878-2186321968f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:41.179147 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24447dd6-d84f-4a59-8878-2186321968f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:41.179254 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef1fb2-c8db-4218-be98-68082e345a16 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:41.179474 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef1fb2-c8db-4218-be98-68082e345a16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:41.179996 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24447dd6-d84f-4a59-8878-2186321968f1 None admin] RBAC: Adding query filter params (role.id=fbd6364b42a641f695c0b265a789057a, scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff, user.id=cd52d2543a9f4b5d9270a12544b0a021) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:41.180301 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24447dd6-d84f-4a59-8878-2186321968f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:41.180875 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef1fb2-c8db-4218-be98-68082e345a16 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:41.181703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24447dd6-d84f-4a59-8878-2186321968f1 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:41.193392 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 321/664] 10.222.0.64 () {56 vars in 1124 bytes} [Thu May 12 16:53:41 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:41.193392 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef1fb2-c8db-4218-be98-68082e345a16 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:41.196210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 344/665] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:53:41 2022] GET /identity/v3/role_assignments?user.id=cd52d2543a9f4b5d9270a12544b0a021&scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff&role.id=fbd6364b42a641f695c0b265a789057a => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:41.307365 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef1fb2-c8db-4218-be98-68082e345a16 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:41.346645 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3937f24-1748-4a97-b48c-1355993e7319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:41.347467 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3937f24-1748-4a97-b48c-1355993e7319 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:41.347781 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3937f24-1748-4a97-b48c-1355993e7319 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:41.348057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3937f24-1748-4a97-b48c-1355993e7319 None admin] PATH_INFO: `/v3/services/network` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:41.348729 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3937f24-1748-4a97-b48c-1355993e7319 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:41.350142 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3937f24-1748-4a97-b48c-1355993e7319 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:41.365840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-a3937f24-1748-4a97-b48c-1355993e7319 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 16:53:41.365840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:41.365840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:53:41.365840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:53:41.365840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:53:41.365840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:53:41.365840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:53:41.365840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:41.365840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 16:53:41.365840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:41.365840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:53:41.365840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:41.365840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:41.365840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:41.365840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:41.365840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:41.365840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:41.366919 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:41.366919 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:41.366919 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:41.366919 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:41.366919 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:41.366919 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:41.366919 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:53:41.366919 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:53:41.366919 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:53:41.366919 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:53:41.366919 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:41.366919 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:41.366919 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:41.366919 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:41.366919 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:41.366919 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:41.367818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:41.367818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:41.367818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:41.367818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:41.367818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:41.367818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:41.367818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:41.367818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:41.367818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:41.367818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:41.367818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:53:41.367818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:41.367818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 16:53:41.367818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:41.367818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 322/666] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:41 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:41.374220 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24447dd6-d84f-4a59-8878-2186321968f1 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:41.489681 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24447dd6-d84f-4a59-8878-2186321968f1 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:41.522999 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce105a8-e4ce-494b-b380-18a8d0147c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:41.524109 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce105a8-e4ce-494b-b380-18a8d0147c8f None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:41.524613 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce105a8-e4ce-494b-b380-18a8d0147c8f None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:41.525089 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce105a8-e4ce-494b-b380-18a8d0147c8f None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:41.526027 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce105a8-e4ce-494b-b380-18a8d0147c8f None admin] RBAC: Adding query filter params (name=network) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:41.526576 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce105a8-e4ce-494b-b380-18a8d0147c8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:41.528221 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce105a8-e4ce-494b-b380-18a8d0147c8f None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:41.533562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 345/667] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 12 16:53:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:41.543681 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3937f24-1748-4a97-b48c-1355993e7319 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:41.652916 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3937f24-1748-4a97-b48c-1355993e7319 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:41.690323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187a6fc-f968-4f50-8ee2-b0f8e06e4507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:41.690997 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187a6fc-f968-4f50-8ee2-b0f8e06e4507 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:41.691285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187a6fc-f968-4f50-8ee2-b0f8e06e4507 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:41.691764 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187a6fc-f968-4f50-8ee2-b0f8e06e4507 None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:41.693096 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187a6fc-f968-4f50-8ee2-b0f8e06e4507 None admin] RBAC: Adding query filter params (type=network) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:41.693562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187a6fc-f968-4f50-8ee2-b0f8e06e4507 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:41.695663 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187a6fc-f968-4f50-8ee2-b0f8e06e4507 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:41.702748 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 323/668] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 12 16:53:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:42.979031 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c14212-7fcd-4bc1-8952-e18727c5570c None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:42.979538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c14212-7fcd-4bc1-8952-e18727c5570c None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:42.979690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c14212-7fcd-4bc1-8952-e18727c5570c None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:42.981230 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 346/669] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:42.987221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911411-3572-46f5-84b0-3cc396c824d7 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:42.987671 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911411-3572-46f5-84b0-3cc396c824d7 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:42.987911 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911411-3572-46f5-84b0-3cc396c824d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:43.004850 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-3e911411-3572-46f5-84b0-3cc396c824d7 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:43.006066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-3e911411-3572-46f5-84b0-3cc396c824d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:43.074021 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 324/670] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:53:43.097696 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c14212-7fcd-4bc1-8952-e18727c5570c None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:43.200838 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c14212-7fcd-4bc1-8952-e18727c5570c None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:43.235202 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5215c8-3812-48be-a960-b6fb51b744c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:43.235901 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5215c8-3812-48be-a960-b6fb51b744c6 None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:43.236184 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5215c8-3812-48be-a960-b6fb51b744c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:43.236462 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5215c8-3812-48be-a960-b6fb51b744c6 None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:43.237196 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5215c8-3812-48be-a960-b6fb51b744c6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:43.238592 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5215c8-3812-48be-a960-b6fb51b744c6 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:43.254561 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 347/671] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 12 16:53:43 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:53:43.592818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a873afe-3679-4b75-9c65-9b11360e7c2d None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:43.593177 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a873afe-3679-4b75-9c65-9b11360e7c2d None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:43.593353 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a873afe-3679-4b75-9c65-9b11360e7c2d None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:43.594983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 325/672] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:53:43.600467 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cc6b1-e7a9-43bc-9cc7-6465f716f6ed None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:43.601014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cc6b1-e7a9-43bc-9cc7-6465f716f6ed None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:43.601295 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cc6b1-e7a9-43bc-9cc7-6465f716f6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:43.618055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-2d2cc6b1-e7a9-43bc-9cc7-6465f716f6ed None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:43.619256 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-2d2cc6b1-e7a9-43bc-9cc7-6465f716f6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:43.693621 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 348/673] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:43 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:43.694752 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377742c1-4d33-4b12-ad9a-e3bcb883f2fe None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:43.695113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377742c1-4d33-4b12-ad9a-e3bcb883f2fe None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:43.695463 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377742c1-4d33-4b12-ad9a-e3bcb883f2fe None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:43.699675 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 326/674] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:43.703010 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2b2dc-745c-43bb-817f-47810525d0e1 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:43.703303 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2b2dc-745c-43bb-817f-47810525d0e1 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:43.703583 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2b2dc-745c-43bb-817f-47810525d0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:43.716916 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377742c1-4d33-4b12-ad9a-e3bcb883f2fe None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:43.721589 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-4eb2b2dc-745c-43bb-817f-47810525d0e1 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:43.723009 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-4eb2b2dc-745c-43bb-817f-47810525d0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:43.809789 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 349/675] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:43 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 16:53:43.828641 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2b2dc-745c-43bb-817f-47810525d0e1 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:43.859096 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377742c1-4d33-4b12-ad9a-e3bcb883f2fe None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:43.899789 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6f64d-dd94-4a19-9e58-c51ba114a608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:43.900661 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6f64d-dd94-4a19-9e58-c51ba114a608 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:43.901818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6f64d-dd94-4a19-9e58-c51ba114a608 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:43.902134 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6f64d-dd94-4a19-9e58-c51ba114a608 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:43.925814 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6f64d-dd94-4a19-9e58-c51ba114a608 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:43.933777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-cea6f64d-dd94-4a19-9e58-c51ba114a608 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:53:43.933777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:43.933777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:43.933777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:43.933777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:43.933777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:43.933777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:43.933777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:43.933777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:43.933777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:43.933777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:43.933777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:43.933777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:43.933777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:43.933777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:43.933777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:43.934775 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:43.934775 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:43.934775 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:43.934775 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:43.934775 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:43.934775 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:43.934775 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:43.934775 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:43.934775 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:43.934775 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:43.934775 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:43.934775 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:43.934775 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:43.934775 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:43.934775 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:43.934775 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:43.936181 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:43.936181 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:43.936181 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:43.936181 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:43.936181 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:43.936181 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:43.936181 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:43.936181 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:43.936181 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:43.936181 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:43.936181 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:53:43.936181 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:43.936181 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 327/676] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 12 16:53:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:43.942762 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6f64d-dd94-4a19-9e58-c51ba114a608 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:43.953198 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2b2dc-745c-43bb-817f-47810525d0e1 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:43.987914 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7dc182-7a6a-4eb2-aaa3-3957fdf9ee76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:43.988721 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7dc182-7a6a-4eb2-aaa3-3957fdf9ee76 None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:43.988925 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7dc182-7a6a-4eb2-aaa3-3957fdf9ee76 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:43.989179 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7dc182-7a6a-4eb2-aaa3-3957fdf9ee76 None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:43.989966 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7dc182-7a6a-4eb2-aaa3-3957fdf9ee76 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:43.991441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7dc182-7a6a-4eb2-aaa3-3957fdf9ee76 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:44.011725 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 350/677] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 12 16:53:43 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 16:53:44.078865 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6f64d-dd94-4a19-9e58-c51ba114a608 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:44.119468 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fef5d-c631-44e0-9e03-574ba9353b7d None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:44.119694 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fef5d-c631-44e0-9e03-574ba9353b7d None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:44.120019 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fef5d-c631-44e0-9e03-574ba9353b7d None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:44.121659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 351/678] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:53:44.132076 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b951d-695c-465e-b6e2-e6a57e399427 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:44.132705 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b951d-695c-465e-b6e2-e6a57e399427 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:44.133190 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b951d-695c-465e-b6e2-e6a57e399427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:44.136265 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec2b40-80ec-4f28-a768-ced5949f2376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:44.136946 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec2b40-80ec-4f28-a768-ced5949f2376 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:44.137227 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec2b40-80ec-4f28-a768-ced5949f2376 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:44.137510 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec2b40-80ec-4f28-a768-ced5949f2376 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:44.138307 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec2b40-80ec-4f28-a768-ced5949f2376 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:44.138611 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec2b40-80ec-4f28-a768-ced5949f2376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:44.140098 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec2b40-80ec-4f28-a768-ced5949f2376 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:44.149769 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 328/679] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:53:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:44.157554 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-a04b951d-695c-465e-b6e2-e6a57e399427 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:44.159076 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-a04b951d-695c-465e-b6e2-e6a57e399427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:44.164119 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec2b40-80ec-4f28-a768-ced5949f2376 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:44.246957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 352/680] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:44 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 16:53:44.272547 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b951d-695c-465e-b6e2-e6a57e399427 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:44.285847 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec2b40-80ec-4f28-a768-ced5949f2376 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:44.327571 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24804d80-9133-41be-947a-e6b950eacb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:44.329412 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24804d80-9133-41be-947a-e6b950eacb7f None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:44.329900 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24804d80-9133-41be-947a-e6b950eacb7f None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:44.330538 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24804d80-9133-41be-947a-e6b950eacb7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:44.344385 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24804d80-9133-41be-947a-e6b950eacb7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:44.346277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24804d80-9133-41be-947a-e6b950eacb7f None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:44.369439 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-24804d80-9133-41be-947a-e6b950eacb7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:44.369439 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:44.369439 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:44.369439 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:44.369439 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:44.369439 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:44.369439 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:44.369439 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:44.369439 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:44.369439 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:44.369439 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:44.369439 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:44.369439 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:44.369439 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:44.369439 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:44.370386 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:44.370386 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:44.370386 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:44.370386 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:44.370386 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:44.370386 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:44.370386 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:44.370386 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:44.370386 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:44.370386 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:44.370386 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:44.370386 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:44.370386 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:44.370386 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:44.370386 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:44.370386 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:44.370386 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:44.371301 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:44.371301 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:44.371301 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:44.371301 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:44.374481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 329/681] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:53:44.379620 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24804d80-9133-41be-947a-e6b950eacb7f None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:44.383499 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b951d-695c-465e-b6e2-e6a57e399427 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:44.417724 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a650f1-bb26-4fdc-b252-5836afb8fb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:44.418637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a650f1-bb26-4fdc-b252-5836afb8fb5c None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:44.419017 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a650f1-bb26-4fdc-b252-5836afb8fb5c None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:44.420018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a650f1-bb26-4fdc-b252-5836afb8fb5c None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:44.420865 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a650f1-bb26-4fdc-b252-5836afb8fb5c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:44.422657 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a650f1-bb26-4fdc-b252-5836afb8fb5c None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:44.451749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 353/682] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 12 16:53:44 2022] POST /identity/v3/services => generated 240 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:53:44.509344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24804d80-9133-41be-947a-e6b950eacb7f None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:44.555043 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d74e8-f8fb-4b78-8146-4ba842f1fa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:44.555764 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d74e8-f8fb-4b78-8146-4ba842f1fa14 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:44.556049 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d74e8-f8fb-4b78-8146-4ba842f1fa14 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:44.556377 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d74e8-f8fb-4b78-8146-4ba842f1fa14 None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:44.557128 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d74e8-f8fb-4b78-8146-4ba842f1fa14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:44.557437 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d74e8-f8fb-4b78-8146-4ba842f1fa14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:44.558995 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d74e8-f8fb-4b78-8146-4ba842f1fa14 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:44.572893 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 330/683] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:44.578055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a650f1-bb26-4fdc-b252-5836afb8fb5c None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:44.698734 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a650f1-bb26-4fdc-b252-5836afb8fb5c None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:44.733353 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3b5a9-8a08-4e55-b7a1-343292009158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:44.734531 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3b5a9-8a08-4e55-b7a1-343292009158 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:44.735042 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3b5a9-8a08-4e55-b7a1-343292009158 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:44.735513 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3b5a9-8a08-4e55-b7a1-343292009158 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:44.744188 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3b5a9-8a08-4e55-b7a1-343292009158 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:44.745905 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3b5a9-8a08-4e55-b7a1-343292009158 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:44.765930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-38b3b5a9-8a08-4e55-b7a1-343292009158 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 16:53:44.765930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:44.765930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:44.765930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:44.765930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:44.765930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:44.765930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:44.765930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:44.765930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:44.765930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:44.765930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:44.765930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:44.765930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:53:44.765930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:53:44.765930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:53:44.765930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:53:44.766870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:44.766870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:44.766870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:53:44.766870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:44.766870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:53:44.766870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:44.766870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:44.766870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:44.766870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:44.766870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:44.766870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:44.766870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:44.766870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:44.766870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:44.766870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:44.766870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:44.766870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:44.766870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:44.767986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:44.767986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:44.767986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:53:44.767986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:53:44.767986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:53:44.767986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:53:44.767986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:53:44.767986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:53:44.767986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 16:53:44.767986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:44.767986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 354/684] 10.222.0.64 () {56 vars in 1093 bytes} [Thu May 12 16:53:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:44.772705 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d74e8-f8fb-4b78-8146-4ba842f1fa14 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:44.877873 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d74e8-f8fb-4b78-8146-4ba842f1fa14 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:44.918740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571f64e-2b6b-4de4-95ea-98fc26642bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:44.923666 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571f64e-2b6b-4de4-95ea-98fc26642bc5 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:44.923666 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571f64e-2b6b-4de4-95ea-98fc26642bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:44.923666 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571f64e-2b6b-4de4-95ea-98fc26642bc5 None admin] PATH_INFO: `/v3/users` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:44.923666 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571f64e-2b6b-4de4-95ea-98fc26642bc5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:44.923666 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571f64e-2b6b-4de4-95ea-98fc26642bc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:44.923666 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571f64e-2b6b-4de4-95ea-98fc26642bc5 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:44.941856 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 331/685] 10.222.0.64 () {56 vars in 1133 bytes} [Thu May 12 16:53:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:44.946897 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3b5a9-8a08-4e55-b7a1-343292009158 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:45.052989 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3b5a9-8a08-4e55-b7a1-343292009158 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:45.090007 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cbd1b-f95b-41b5-bb95-aa2b401640b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:45.091856 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cbd1b-f95b-41b5-bb95-aa2b401640b1 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:45.092359 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cbd1b-f95b-41b5-bb95-aa2b401640b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:45.092958 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cbd1b-f95b-41b5-bb95-aa2b401640b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:45.104701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cbd1b-f95b-41b5-bb95-aa2b401640b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:45.106500 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cbd1b-f95b-41b5-bb95-aa2b401640b1 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:45.124820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-807cbd1b-f95b-41b5-bb95-aa2b401640b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:45.124820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:45.124820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:45.124820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:45.124820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:45.124820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:45.124820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:45.124820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:45.124820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:45.124820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:45.124820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:45.124820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:45.124820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:45.124820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:45.124820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:45.125801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:45.125801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:45.125801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:45.125801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:45.125801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:45.125801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:45.125801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:45.125801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:45.125801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:45.125801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:45.125801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:45.125801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:45.125801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:45.125801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:45.125801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:45.125801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:45.125801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:45.126766 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:45.126766 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:45.126766 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:45.126766 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:45.129174 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 355/686] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:45.139656 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571f64e-2b6b-4de4-95ea-98fc26642bc5 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:45.237653 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571f64e-2b6b-4de4-95ea-98fc26642bc5 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:45.271926 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698f914-3a0d-4c4c-8cfd-a75d2fa1e9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:45.272586 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698f914-3a0d-4c4c-8cfd-a75d2fa1e9f7 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:45.272860 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698f914-3a0d-4c4c-8cfd-a75d2fa1e9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:45.273130 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698f914-3a0d-4c4c-8cfd-a75d2fa1e9f7 None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:45.273845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698f914-3a0d-4c4c-8cfd-a75d2fa1e9f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:45.274191 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698f914-3a0d-4c4c-8cfd-a75d2fa1e9f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:45.275596 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698f914-3a0d-4c4c-8cfd-a75d2fa1e9f7 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:45.287397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 332/687] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:45.292521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cbd1b-f95b-41b5-bb95-aa2b401640b1 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:45.394773 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cbd1b-f95b-41b5-bb95-aa2b401640b1 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:45.429212 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f9791-389d-4d17-9b35-a287d81e41e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:45.430059 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f9791-389d-4d17-9b35-a287d81e41e1 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:45.430390 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f9791-389d-4d17-9b35-a287d81e41e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:45.430672 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f9791-389d-4d17-9b35-a287d81e41e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:45.438462 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f9791-389d-4d17-9b35-a287d81e41e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:45.440244 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f9791-389d-4d17-9b35-a287d81e41e1 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:45.454796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-3a2f9791-389d-4d17-9b35-a287d81e41e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:45.454796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:45.454796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:45.454796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:45.454796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:45.454796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:45.454796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:45.454796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:45.454796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:45.454796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:45.454796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:45.454796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:45.454796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:53:45.454796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:53:45.454796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:53:45.455821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:53:45.455821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:45.455821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:45.455821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:45.455821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:45.455821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:45.455821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:45.455821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:45.455821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:45.455821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:45.455821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:45.455821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:45.455821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:45.455821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:45.455821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:45.455821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:45.455821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:45.456686 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:53:45.456686 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:53:45.456686 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:53:45.456686 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:53:45.456686 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:53:45.456686 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:53:45.456686 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:45.456686 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:45.456686 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 356/688] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:45.462151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698f914-3a0d-4c4c-8cfd-a75d2fa1e9f7 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:45.568929 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698f914-3a0d-4c4c-8cfd-a75d2fa1e9f7 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:45.602156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f46b31-a8e4-4d69-b73e-6e9f64ad90d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:45.602814 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f46b31-a8e4-4d69-b73e-6e9f64ad90d8 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:45.603094 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f46b31-a8e4-4d69-b73e-6e9f64ad90d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:45.603369 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f46b31-a8e4-4d69-b73e-6e9f64ad90d8 None admin] PATH_INFO: `/v3/projects` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:45.604175 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f46b31-a8e4-4d69-b73e-6e9f64ad90d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:45.604484 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f46b31-a8e4-4d69-b73e-6e9f64ad90d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:45.605904 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f46b31-a8e4-4d69-b73e-6e9f64ad90d8 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:45.618544 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 333/689] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:53:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:45.626681 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f9791-389d-4d17-9b35-a287d81e41e1 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:45.690223 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c1603-177e-43bd-a276-acc0e96d6d87 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:45.690578 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c1603-177e-43bd-a276-acc0e96d6d87 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:45.690959 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c1603-177e-43bd-a276-acc0e96d6d87 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:45.692664 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 334/690] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:53:45.697551 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1de21-f020-418e-bef8-19241627bc13 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:45.697936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1de21-f020-418e-bef8-19241627bc13 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:45.698320 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1de21-f020-418e-bef8-19241627bc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:45.719303 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-b3d1de21-f020-418e-bef8-19241627bc13 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:45.720664 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-b3d1de21-f020-418e-bef8-19241627bc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:45.735281 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f9791-389d-4d17-9b35-a287d81e41e1 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:45.774605 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c563a37-698f-4479-947e-114a10ad36e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:45.775779 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c563a37-698f-4479-947e-114a10ad36e0 None admin] REQUEST_METHOD: `PUT` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:45.776121 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c563a37-698f-4479-947e-114a10ad36e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:45.776397 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c563a37-698f-4479-947e-114a10ad36e0 None admin] PATH_INFO: `/v3/projects/d2ccefb3ecb0493bb0240a3853bfa5ff/users/cd52d2543a9f4b5d9270a12544b0a021/roles/fbd6364b42a641f695c0b265a789057a` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:45.780033 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c563a37-698f-4479-947e-114a10ad36e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2ccefb3ecb0493bb0240a3853bfa5ff, user_id=cd52d2543a9f4b5d9270a12544b0a021, role_id=fbd6364b42a641f695c0b265a789057a)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:45.782113 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c563a37-698f-4479-947e-114a10ad36e0 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:45.787933 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 335/691] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:45 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 16:53:45.797662 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 357/692] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 12 16:53:45 2022] PUT /identity/v3/projects/d2ccefb3ecb0493bb0240a3853bfa5ff/users/cd52d2543a9f4b5d9270a12544b0a021/roles/fbd6364b42a641f695c0b265a789057a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:53:45.811761 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1de21-f020-418e-bef8-19241627bc13 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:45.926430 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1de21-f020-418e-bef8-19241627bc13 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:45.963603 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd185d8-101a-4e35-b20c-08d57a125d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:45.964400 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd185d8-101a-4e35-b20c-08d57a125d48 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:45.964675 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd185d8-101a-4e35-b20c-08d57a125d48 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:45.964997 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd185d8-101a-4e35-b20c-08d57a125d48 None admin] PATH_INFO: `/v3/services/image` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:45.965660 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd185d8-101a-4e35-b20c-08d57a125d48 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:45.967170 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd185d8-101a-4e35-b20c-08d57a125d48 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:45.979727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-dcd185d8-101a-4e35-b20c-08d57a125d48 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 16:53:45.979727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:45.979727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:53:45.979727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:53:45.979727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:53:45.979727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:53:45.979727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:53:45.979727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:45.979727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 16:53:45.979727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:45.979727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:53:45.979727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:45.979727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:45.979727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:45.979727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:45.979727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:45.979727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:45.980744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:45.980744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:45.980744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:45.980744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:45.980744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:45.980744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:45.980744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:53:45.980744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:53:45.980744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:53:45.980744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:53:45.980744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:45.980744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:45.980744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:45.980744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:45.980744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:45.980744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:45.981579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:45.981579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:45.981579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:45.981579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:45.981579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:45.981579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:45.981579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:45.981579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:45.981579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:45.981579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:45.981579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:53:45.981579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:45.981579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 16:53:45.981579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:45.981579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 336/693] 10.222.0.64 () {56 vars in 1105 bytes} [Thu May 12 16:53:45 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:45.987382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c563a37-698f-4479-947e-114a10ad36e0 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:46.085917 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c563a37-698f-4479-947e-114a10ad36e0 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:46.119972 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cb0b3-5695-4c82-a4ff-e721080e0a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:46.120634 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cb0b3-5695-4c82-a4ff-e721080e0a8a None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:46.120908 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cb0b3-5695-4c82-a4ff-e721080e0a8a None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:46.121180 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cb0b3-5695-4c82-a4ff-e721080e0a8a None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:46.121884 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cb0b3-5695-4c82-a4ff-e721080e0a8a None admin] RBAC: Adding query filter params (name=image) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:46.122183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cb0b3-5695-4c82-a4ff-e721080e0a8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:46.124098 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cb0b3-5695-4c82-a4ff-e721080e0a8a None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:46.128943 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 358/694] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:46.134456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd185d8-101a-4e35-b20c-08d57a125d48 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:46.236130 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd185d8-101a-4e35-b20c-08d57a125d48 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:46.269297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da436c-85ff-4d91-87b2-644286accbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:46.270011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da436c-85ff-4d91-87b2-644286accbc4 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:46.270293 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da436c-85ff-4d91-87b2-644286accbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:46.270558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da436c-85ff-4d91-87b2-644286accbc4 None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:46.271254 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da436c-85ff-4d91-87b2-644286accbc4 None admin] RBAC: Adding query filter params (type=image) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:46.271554 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da436c-85ff-4d91-87b2-644286accbc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:46.272949 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da436c-85ff-4d91-87b2-644286accbc4 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:46.278055 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 337/695] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:46.284295 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cb0b3-5695-4c82-a4ff-e721080e0a8a None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:46.391602 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cb0b3-5695-4c82-a4ff-e721080e0a8a None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:46.438046 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5c400-72e4-4141-a8a3-dc9ce631839e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:46.438749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5c400-72e4-4141-a8a3-dc9ce631839e None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:46.439089 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5c400-72e4-4141-a8a3-dc9ce631839e None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:46.443659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5c400-72e4-4141-a8a3-dc9ce631839e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:46.443659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5c400-72e4-4141-a8a3-dc9ce631839e None admin] RBAC: Adding query filter params (interface=public, service_id=9aa87be81308464996552e62b2f704af, region_id=RegionOne) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:46.443659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5c400-72e4-4141-a8a3-dc9ce631839e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:46.443659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5c400-72e4-4141-a8a3-dc9ce631839e None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:46.451666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 359/696] 10.222.0.64 () {56 vars in 1251 bytes} [Thu May 12 16:53:46 2022] GET /identity/v3/endpoints?service_id=9aa87be81308464996552e62b2f704af&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:46.456505 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da436c-85ff-4d91-87b2-644286accbc4 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:46.564141 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da436c-85ff-4d91-87b2-644286accbc4 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:46.598679 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77496d48-3ab2-4075-a860-df1e29052f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:46.599258 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77496d48-3ab2-4075-a860-df1e29052f8b None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:46.599537 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77496d48-3ab2-4075-a860-df1e29052f8b None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:46.599841 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77496d48-3ab2-4075-a860-df1e29052f8b None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:46.600515 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77496d48-3ab2-4075-a860-df1e29052f8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:46.602142 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77496d48-3ab2-4075-a860-df1e29052f8b None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:46.607896 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 338/697] 10.222.0.64 () {56 vars in 1087 bytes} [Thu May 12 16:53:46 2022] GET /identity/v3/services => generated 1002 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:53:46.612532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850d6e4-43c4-4366-9849-426796b3f937 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:46.612824 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850d6e4-43c4-4366-9849-426796b3f937 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:46.613100 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850d6e4-43c4-4366-9849-426796b3f937 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:46.614444 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 360/698] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:46.620239 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749a3fc-c5d2-4642-aec0-46d56745a6b9 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:46.620561 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749a3fc-c5d2-4642-aec0-46d56745a6b9 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:46.620806 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749a3fc-c5d2-4642-aec0-46d56745a6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:46.639763 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-5749a3fc-c5d2-4642-aec0-46d56745a6b9 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:46.641068 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-5749a3fc-c5d2-4642-aec0-46d56745a6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:46.715797 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 339/699] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:46 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:53:46.740133 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850d6e4-43c4-4366-9849-426796b3f937 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:46.861649 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850d6e4-43c4-4366-9849-426796b3f937 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:46.895571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad743d01-ae7a-4f28-9fc8-43d76690befe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:46.896457 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad743d01-ae7a-4f28-9fc8-43d76690befe None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:46.896780 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad743d01-ae7a-4f28-9fc8-43d76690befe None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:46.897054 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad743d01-ae7a-4f28-9fc8-43d76690befe None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:46.897704 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad743d01-ae7a-4f28-9fc8-43d76690befe None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:46.899112 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad743d01-ae7a-4f28-9fc8-43d76690befe None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:46.912391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-ad743d01-ae7a-4f28-9fc8-43d76690befe None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 16:53:46.912391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:46.912391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:53:46.912391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:53:46.912391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:53:46.912391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:53:46.912391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:53:46.912391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:46.912391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 16:53:46.912391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:46.912391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:53:46.912391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:46.912391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:46.912391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:46.912391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:46.912391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:46.914617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:46.914617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:46.914617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:46.914617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:46.914617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:46.914617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:46.914617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:46.914617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:53:46.914617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:53:46.914617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:53:46.914617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:53:46.914617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:46.914617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:46.914617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:46.914617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:46.914617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:46.916650 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:46.916650 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:46.916650 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:46.916650 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:46.916650 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:46.916650 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:46.916650 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:46.916650 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:46.916650 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:46.916650 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:46.916650 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:46.916650 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:53:46.916650 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:46.916650 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 16:53:46.916650 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:46.916650 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 361/700] 10.222.0.64 () {56 vars in 1129 bytes} [Thu May 12 16:53:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:46.923667 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749a3fc-c5d2-4642-aec0-46d56745a6b9 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:46.987360 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6ee62-5a4e-4af8-a0c9-381eb406ded9 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:46.987698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6ee62-5a4e-4af8-a0c9-381eb406ded9 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:46.987910 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6ee62-5a4e-4af8-a0c9-381eb406ded9 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:46.989645 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 362/701] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:46.995071 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8b4a4-269f-4240-8d82-60e5aa327e99 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:46.995413 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8b4a4-269f-4240-8d82-60e5aa327e99 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:46.995727 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8b4a4-269f-4240-8d82-60e5aa327e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:47.014295 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-16f8b4a4-269f-4240-8d82-60e5aa327e99 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:47.015540 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-16f8b4a4-269f-4240-8d82-60e5aa327e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:47.023441 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749a3fc-c5d2-4642-aec0-46d56745a6b9 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:47.064263 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c61b3d-83f8-4ed6-88fc-ae4d20b112de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:47.065083 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c61b3d-83f8-4ed6-88fc-ae4d20b112de None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:47.065434 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c61b3d-83f8-4ed6-88fc-ae4d20b112de None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:47.065785 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c61b3d-83f8-4ed6-88fc-ae4d20b112de None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:47.067246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c61b3d-83f8-4ed6-88fc-ae4d20b112de None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:47.067655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c61b3d-83f8-4ed6-88fc-ae4d20b112de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:47.069538 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c61b3d-83f8-4ed6-88fc-ae4d20b112de None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:47.076642 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 340/702] 10.222.0.64 () {56 vars in 1124 bytes} [Thu May 12 16:53:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:47.081723 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c61b3d-83f8-4ed6-88fc-ae4d20b112de None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:47.107688 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 363/703] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:46 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 16:53:47.136040 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8b4a4-269f-4240-8d82-60e5aa327e99 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:47.191929 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c61b3d-83f8-4ed6-88fc-ae4d20b112de None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:47.228114 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fbe83-539f-42f8-9c59-61846b64d5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:47.229103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fbe83-539f-42f8-9c59-61846b64d5e7 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:47.229585 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fbe83-539f-42f8-9c59-61846b64d5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:47.230059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fbe83-539f-42f8-9c59-61846b64d5e7 None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:47.230991 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fbe83-539f-42f8-9c59-61846b64d5e7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:47.231504 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fbe83-539f-42f8-9c59-61846b64d5e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:47.233604 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fbe83-539f-42f8-9c59-61846b64d5e7 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:47.243617 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 341/704] 10.222.0.64 () {56 vars in 1124 bytes} [Thu May 12 16:53:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:47.245183 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fbe83-539f-42f8-9c59-61846b64d5e7 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:47.264553 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8b4a4-269f-4240-8d82-60e5aa327e99 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:47.297708 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3adac1-d5ef-4295-9b14-715995880529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:47.298840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3adac1-d5ef-4295-9b14-715995880529 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:47.299320 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3adac1-d5ef-4295-9b14-715995880529 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:47.299870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3adac1-d5ef-4295-9b14-715995880529 None admin] PATH_INFO: `/v3/services/network` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:47.300842 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3adac1-d5ef-4295-9b14-715995880529 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:47.302420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3adac1-d5ef-4295-9b14-715995880529 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:47.314627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-1b3adac1-d5ef-4295-9b14-715995880529 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 16:53:47.314627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:47.314627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:53:47.314627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:53:47.314627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:53:47.314627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:53:47.314627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:53:47.314627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:47.314627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 16:53:47.314627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:47.314627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:53:47.314627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:47.314627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:47.314627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:47.314627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:47.314627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:47.314627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:47.315612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:47.315612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:47.315612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:47.315612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:47.315612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:47.315612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:47.315612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:53:47.315612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:53:47.315612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:53:47.315612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:53:47.315612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:47.315612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:47.315612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:47.315612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:47.315612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:47.315612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:47.316720 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:47.316720 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:47.316720 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:47.316720 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:47.316720 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:47.316720 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:47.316720 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:47.316720 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:47.316720 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:47.316720 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:47.316720 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:53:47.316720 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:47.316720 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 16:53:47.316720 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:47.319284 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 364/705] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:47 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:53:47.324910 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3adac1-d5ef-4295-9b14-715995880529 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:47.368377 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fbe83-539f-42f8-9c59-61846b64d5e7 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:47.409545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a517bb5-cd6c-43c7-95ce-ad35d698ee71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:47.410166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a517bb5-cd6c-43c7-95ce-ad35d698ee71 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:47.410451 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a517bb5-cd6c-43c7-95ce-ad35d698ee71 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:47.410728 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a517bb5-cd6c-43c7-95ce-ad35d698ee71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:47.411521 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a517bb5-cd6c-43c7-95ce-ad35d698ee71 None admin] RBAC: Adding query filter params (interface=public, service_id=ea1bc01d2c58473a9858c6895e537ef9, region_id=RegionOne) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:47.411906 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a517bb5-cd6c-43c7-95ce-ad35d698ee71 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:47.413288 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a517bb5-cd6c-43c7-95ce-ad35d698ee71 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:47.428365 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 342/706] 10.222.0.64 () {56 vars in 1251 bytes} [Thu May 12 16:53:47 2022] GET /identity/v3/endpoints?service_id=ea1bc01d2c58473a9858c6895e537ef9&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:47.429751 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a517bb5-cd6c-43c7-95ce-ad35d698ee71 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:47.449499 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3adac1-d5ef-4295-9b14-715995880529 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:47.488178 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b661de6-991b-4205-806c-32a2a4b23f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:47.489073 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b661de6-991b-4205-806c-32a2a4b23f44 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:47.489286 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b661de6-991b-4205-806c-32a2a4b23f44 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:47.489616 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b661de6-991b-4205-806c-32a2a4b23f44 None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:47.490596 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b661de6-991b-4205-806c-32a2a4b23f44 None admin] RBAC: Adding query filter params (name=network) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:47.490714 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b661de6-991b-4205-806c-32a2a4b23f44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:47.492056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b661de6-991b-4205-806c-32a2a4b23f44 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:47.501375 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 365/707] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 12 16:53:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:47.502716 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b661de6-991b-4205-806c-32a2a4b23f44 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:47.533106 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a517bb5-cd6c-43c7-95ce-ad35d698ee71 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:47.566925 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049d45a-40f3-4e70-91a6-6155da2df0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:47.567991 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049d45a-40f3-4e70-91a6-6155da2df0b8 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:47.568470 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049d45a-40f3-4e70-91a6-6155da2df0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:47.568941 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049d45a-40f3-4e70-91a6-6155da2df0b8 None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:47.569816 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049d45a-40f3-4e70-91a6-6155da2df0b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:47.571373 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049d45a-40f3-4e70-91a6-6155da2df0b8 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:47.583930 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 343/708] 10.222.0.64 () {56 vars in 1087 bytes} [Thu May 12 16:53:47 2022] GET /identity/v3/services => generated 1002 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:53:47.607803 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b661de6-991b-4205-806c-32a2a4b23f44 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:47.644538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6bb63-95fe-4fef-979e-f5209b087d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:47.645226 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6bb63-95fe-4fef-979e-f5209b087d90 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:47.645514 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6bb63-95fe-4fef-979e-f5209b087d90 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:47.645790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6bb63-95fe-4fef-979e-f5209b087d90 None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:47.646575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6bb63-95fe-4fef-979e-f5209b087d90 None admin] RBAC: Adding query filter params (type=network) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:47.646892 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6bb63-95fe-4fef-979e-f5209b087d90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:47.648423 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6bb63-95fe-4fef-979e-f5209b087d90 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:47.655202 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 366/709] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 12 16:53:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:47.661214 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049d45a-40f3-4e70-91a6-6155da2df0b8 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:47.773398 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049d45a-40f3-4e70-91a6-6155da2df0b8 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:47.812487 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5c10f-cf4d-4bff-9455-d6a5421abbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:47.813373 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5c10f-cf4d-4bff-9455-d6a5421abbfb None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:47.813655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5c10f-cf4d-4bff-9455-d6a5421abbfb None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:47.813956 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5c10f-cf4d-4bff-9455-d6a5421abbfb None admin] PATH_INFO: `/v3/endpoints` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:47.814714 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5c10f-cf4d-4bff-9455-d6a5421abbfb None admin] RBAC: Adding query filter params (interface=public, service_id=851ca7b240a34dc0b88ad01afe6a0992, region_id=RegionOne) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:47.815024 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5c10f-cf4d-4bff-9455-d6a5421abbfb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:47.816430 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5c10f-cf4d-4bff-9455-d6a5421abbfb None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:47.821920 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 344/710] 10.222.0.64 () {56 vars in 1251 bytes} [Thu May 12 16:53:47 2022] GET /identity/v3/endpoints?service_id=851ca7b240a34dc0b88ad01afe6a0992&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:47.828093 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6bb63-95fe-4fef-979e-f5209b087d90 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:47.943161 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6bb63-95fe-4fef-979e-f5209b087d90 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:47.977272 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6372ea-d4af-4ab4-a49a-c16eba102e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:47.977930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6372ea-d4af-4ab4-a49a-c16eba102e0d None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:47.978209 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6372ea-d4af-4ab4-a49a-c16eba102e0d None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:47.978481 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6372ea-d4af-4ab4-a49a-c16eba102e0d None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:47.979157 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6372ea-d4af-4ab4-a49a-c16eba102e0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:47.980562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6372ea-d4af-4ab4-a49a-c16eba102e0d None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:47.986348 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 367/711] 10.222.0.64 () {56 vars in 1087 bytes} [Thu May 12 16:53:47 2022] GET /identity/v3/services => generated 1002 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:53:48.272678 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a8728-8a93-4382-b57e-c923d4c1a99d None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:48.273165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a8728-8a93-4382-b57e-c923d4c1a99d None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:48.273165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a8728-8a93-4382-b57e-c923d4c1a99d None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:48.274657 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 345/712] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:48.280205 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbda1f-cf8d-4510-bd8c-8fdc89949519 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:48.281027 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbda1f-cf8d-4510-bd8c-8fdc89949519 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:48.281531 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbda1f-cf8d-4510-bd8c-8fdc89949519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:48.298933 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-49dbda1f-cf8d-4510-bd8c-8fdc89949519 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:48.300564 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-49dbda1f-cf8d-4510-bd8c-8fdc89949519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:48.368816 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 368/713] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:48 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:53:48.393217 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a8728-8a93-4382-b57e-c923d4c1a99d None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:48.496659 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a8728-8a93-4382-b57e-c923d4c1a99d None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:48.531803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee87cc0-f545-45bc-b3cc-71b4b5003500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:48.532973 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee87cc0-f545-45bc-b3cc-71b4b5003500 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:48.533473 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee87cc0-f545-45bc-b3cc-71b4b5003500 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:48.533970 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee87cc0-f545-45bc-b3cc-71b4b5003500 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:48.546153 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee87cc0-f545-45bc-b3cc-71b4b5003500 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:53:48.554823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-fee87cc0-f545-45bc-b3cc-71b4b5003500 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:53:48.554823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:48.554823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:48.554823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:48.554823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:48.554823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:48.554823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:48.554823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:48.554823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:48.554823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:48.554823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:48.554823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:48.554823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:53:48.554823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:53:48.554823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:53:48.554823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:53:48.555784 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:53:48.555784 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:53:48.555784 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:53:48.555784 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:53:48.555784 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:48.555784 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:48.555784 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:48.555784 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:48.555784 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:48.555784 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:48.555784 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:48.555784 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:48.555784 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:48.555784 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:48.555784 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:48.555784 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:48.556648 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:48.556648 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:48.556648 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:48.556648 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:48.556648 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:53:48.556648 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:53:48.556648 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:53:48.556648 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:53:48.556648 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:53:48.556648 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:53:48.556648 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:53:48.556648 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:48.559434 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 346/714] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 12 16:53:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:48.565557 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbda1f-cf8d-4510-bd8c-8fdc89949519 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:48.670081 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbda1f-cf8d-4510-bd8c-8fdc89949519 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:48.703955 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f0b85-a216-404a-8f68-f0f25562574a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:48.704629 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f0b85-a216-404a-8f68-f0f25562574a None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:48.704914 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f0b85-a216-404a-8f68-f0f25562574a None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:48.705194 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f0b85-a216-404a-8f68-f0f25562574a None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:48.705951 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f0b85-a216-404a-8f68-f0f25562574a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:48.706260 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f0b85-a216-404a-8f68-f0f25562574a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:48.707667 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f0b85-a216-404a-8f68-f0f25562574a None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:48.716797 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 369/715] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:53:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:48.722294 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee87cc0-f545-45bc-b3cc-71b4b5003500 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:48.833372 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee87cc0-f545-45bc-b3cc-71b4b5003500 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:48.872935 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f535750-ad34-4aa6-b0c0-410a25bb3c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:48.873730 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f535750-ad34-4aa6-b0c0-410a25bb3c54 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:48.874071 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f535750-ad34-4aa6-b0c0-410a25bb3c54 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:48.874349 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f535750-ad34-4aa6-b0c0-410a25bb3c54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:48.884980 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f535750-ad34-4aa6-b0c0-410a25bb3c54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:48.886494 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f535750-ad34-4aa6-b0c0-410a25bb3c54 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:48.906118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-0f535750-ad34-4aa6-b0c0-410a25bb3c54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:48.906118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:48.906118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:48.906118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:48.906118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:48.906118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:48.906118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:48.906118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:48.906118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:48.906118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:48.906118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:48.906118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:48.906118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:48.906118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:48.906118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:48.907059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:48.907059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:48.907059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:48.907059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:48.907059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:48.907059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:48.907059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:48.907059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:48.907059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:48.907059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:48.907059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:48.907059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:48.907059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:48.907059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:48.907059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:48.907059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:48.907059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:48.907967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:48.907967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:48.907967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:48.907967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:48.907967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 347/716] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:48.916020 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f0b85-a216-404a-8f68-f0f25562574a None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:49.016284 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef047dbf-4174-4c07-b943-8c311750abcd None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:49.016612 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef047dbf-4174-4c07-b943-8c311750abcd None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:49.016813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef047dbf-4174-4c07-b943-8c311750abcd None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:49.019757 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 348/717] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:49.022908 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f0b85-a216-404a-8f68-f0f25562574a None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:49.023699 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d11fe-b0b6-467d-a8a4-c0cd79c3b7ad None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:49.023991 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d11fe-b0b6-467d-a8a4-c0cd79c3b7ad None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:49.024271 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d11fe-b0b6-467d-a8a4-c0cd79c3b7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:49.042376 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-409d11fe-b0b6-467d-a8a4-c0cd79c3b7ad None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:49.044236 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-409d11fe-b0b6-467d-a8a4-c0cd79c3b7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:49.056623 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e55e29-f7b5-444a-b5a2-68de82844571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:49.057291 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e55e29-f7b5-444a-b5a2-68de82844571 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:49.057573 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e55e29-f7b5-444a-b5a2-68de82844571 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:49.057851 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e55e29-f7b5-444a-b5a2-68de82844571 None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:49.058570 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e55e29-f7b5-444a-b5a2-68de82844571 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:49.058875 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e55e29-f7b5-444a-b5a2-68de82844571 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:49.060313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e55e29-f7b5-444a-b5a2-68de82844571 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:49.072596 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 370/718] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:49.078541 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e55e29-f7b5-444a-b5a2-68de82844571 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:49.125358 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 349/719] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:49 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 16:53:49.148964 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d11fe-b0b6-467d-a8a4-c0cd79c3b7ad None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:49.188738 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e55e29-f7b5-444a-b5a2-68de82844571 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:49.224249 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57962cc0-f010-45a1-95d0-e1d24bf12179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:49.225072 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57962cc0-f010-45a1-95d0-e1d24bf12179 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:49.225422 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57962cc0-f010-45a1-95d0-e1d24bf12179 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:49.225955 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57962cc0-f010-45a1-95d0-e1d24bf12179 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:49.234929 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57962cc0-f010-45a1-95d0-e1d24bf12179 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:49.236485 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57962cc0-f010-45a1-95d0-e1d24bf12179 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:49.253571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-57962cc0-f010-45a1-95d0-e1d24bf12179 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 16:53:49.253571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:49.253571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:49.253571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:49.253571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:49.253571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:49.253571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:49.253571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:49.253571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:49.253571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:49.253571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:49.253571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:49.253571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:53:49.253571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:53:49.253571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:53:49.253571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:53:49.255853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:49.255853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:49.255853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:53:49.255853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:49.255853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:53:49.255853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:53:49.255853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:49.255853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:49.255853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:49.255853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:49.255853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:49.255853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:49.255853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:49.255853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:49.255853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:49.255853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:49.255853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:49.255853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:49.258132 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:49.258132 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:49.258132 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:53:49.258132 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:53:49.258132 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:53:49.258132 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:53:49.258132 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:53:49.258132 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:53:49.258132 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 16:53:49.258132 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:49.259405 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d11fe-b0b6-467d-a8a4-c0cd79c3b7ad None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:49.259557 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 371/720] 10.222.0.64 () {56 vars in 1093 bytes} [Thu May 12 16:53:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:53:49.267665 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57962cc0-f010-45a1-95d0-e1d24bf12179 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:49.288855 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2b719-2175-402d-a8d6-2eaee33f5df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:49.289674 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2b719-2175-402d-a8d6-2eaee33f5df2 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:49.289957 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2b719-2175-402d-a8d6-2eaee33f5df2 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:49.290234 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2b719-2175-402d-a8d6-2eaee33f5df2 None admin] PATH_INFO: `/v3/services/image` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:49.290893 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2b719-2175-402d-a8d6-2eaee33f5df2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:49.292277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2b719-2175-402d-a8d6-2eaee33f5df2 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:49.304235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-86d2b719-2175-402d-a8d6-2eaee33f5df2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 16:53:49.304235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:49.304235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:53:49.304235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:53:49.304235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:53:49.304235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:53:49.304235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:53:49.304235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:49.304235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 16:53:49.304235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:49.304235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:53:49.304235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:49.304235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:49.304235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:49.304235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:49.304235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:49.304235 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:49.306592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:49.306592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:49.306592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:49.306592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:49.306592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:49.306592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:49.306592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:53:49.306592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:53:49.306592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:53:49.306592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:53:49.306592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:49.306592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:49.306592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:49.306592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:49.306592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:49.306592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:49.308677 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:49.308677 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:49.308677 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:49.308677 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:49.308677 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:49.308677 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:49.308677 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:49.308677 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:49.308677 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:49.308677 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:49.308677 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:53:49.308677 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:49.308677 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 16:53:49.308677 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:49.311034 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 350/721] 10.222.0.64 () {56 vars in 1105 bytes} [Thu May 12 16:53:49 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:53:49.319657 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2b719-2175-402d-a8d6-2eaee33f5df2 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:49.362496 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57962cc0-f010-45a1-95d0-e1d24bf12179 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:49.397681 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08a9c1-2b93-411d-a799-e41e0872e482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:49.398352 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08a9c1-2b93-411d-a799-e41e0872e482 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:49.398633 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08a9c1-2b93-411d-a799-e41e0872e482 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:49.398904 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08a9c1-2b93-411d-a799-e41e0872e482 None admin] PATH_INFO: `/v3/users` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:49.399771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08a9c1-2b93-411d-a799-e41e0872e482 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:49.400080 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08a9c1-2b93-411d-a799-e41e0872e482 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:49.401540 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08a9c1-2b93-411d-a799-e41e0872e482 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:49.412848 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2b719-2175-402d-a8d6-2eaee33f5df2 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:49.424640 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 372/722] 10.222.0.64 () {56 vars in 1133 bytes} [Thu May 12 16:53:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:49.425747 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08a9c1-2b93-411d-a799-e41e0872e482 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:49.447673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f65ab6-8ae9-487f-bad2-0f39e74f8568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:49.448351 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f65ab6-8ae9-487f-bad2-0f39e74f8568 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:49.448634 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f65ab6-8ae9-487f-bad2-0f39e74f8568 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:49.448909 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f65ab6-8ae9-487f-bad2-0f39e74f8568 None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:49.449613 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f65ab6-8ae9-487f-bad2-0f39e74f8568 None admin] RBAC: Adding query filter params (name=image) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:49.449919 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f65ab6-8ae9-487f-bad2-0f39e74f8568 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:49.451945 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f65ab6-8ae9-487f-bad2-0f39e74f8568 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:49.461148 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 351/723] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:49.462416 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f65ab6-8ae9-487f-bad2-0f39e74f8568 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:49.531032 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08a9c1-2b93-411d-a799-e41e0872e482 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:49.566817 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dcb9a-9393-4967-b32f-200d172fdc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:49.567472 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dcb9a-9393-4967-b32f-200d172fdc55 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:49.567847 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dcb9a-9393-4967-b32f-200d172fdc55 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:49.568131 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0dcb9a-9393-4967-b32f-200d172fdc55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:49.568908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f65ab6-8ae9-487f-bad2-0f39e74f8568 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:49.602940 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142a6e8-a6b8-4888-aebc-ed1969eb6e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:49.603657 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a6e8-a6b8-4888-aebc-ed1969eb6e1d None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:49.603955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a6e8-a6b8-4888-aebc-ed1969eb6e1d None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:49.604234 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a6e8-a6b8-4888-aebc-ed1969eb6e1d None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:49.604944 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142a6e8-a6b8-4888-aebc-ed1969eb6e1d None admin] RBAC: Adding query filter params (type=image) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:49.605249 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142a6e8-a6b8-4888-aebc-ed1969eb6e1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:49.606655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142a6e8-a6b8-4888-aebc-ed1969eb6e1d None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:49.616172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 352/724] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:49.617817 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142a6e8-a6b8-4888-aebc-ed1969eb6e1d None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:49.638424 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dcb9a-9393-4967-b32f-200d172fdc55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:49.639988 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0dcb9a-9393-4967-b32f-200d172fdc55 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:49.721799 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142a6e8-a6b8-4888-aebc-ed1969eb6e1d None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:49.744394 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 373/725] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:49 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 16:53:49.745401 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dcb9a-9393-4967-b32f-200d172fdc55 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:49.756454 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f916a61-04ce-4758-a6c8-70d7f7e88690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:49.757121 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f916a61-04ce-4758-a6c8-70d7f7e88690 None admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:49.757403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f916a61-04ce-4758-a6c8-70d7f7e88690 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:49.757684 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f916a61-04ce-4758-a6c8-70d7f7e88690 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:49.758422 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f916a61-04ce-4758-a6c8-70d7f7e88690 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:49.759819 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f916a61-04ce-4758-a6c8-70d7f7e88690 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:49.787871 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 353/726] 10.222.0.64 () {60 vars in 1144 bytes} [Thu May 12 16:53:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 16:53:49.870087 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0dcb9a-9393-4967-b32f-200d172fdc55 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:49.921328 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54141a7e-fcaa-4b83-b667-edf03447a7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:49.922153 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54141a7e-fcaa-4b83-b667-edf03447a7cc None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:49.922484 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54141a7e-fcaa-4b83-b667-edf03447a7cc None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:49.922766 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54141a7e-fcaa-4b83-b667-edf03447a7cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:49.934554 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54141a7e-fcaa-4b83-b667-edf03447a7cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:49.936219 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54141a7e-fcaa-4b83-b667-edf03447a7cc None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:49.959304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-54141a7e-fcaa-4b83-b667-edf03447a7cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:49.959304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:49.959304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:49.959304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:49.959304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:49.959304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:49.959304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:49.959304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:49.959304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:49.959304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:49.959304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:49.959304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:49.959304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:49.959304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:49.959304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:49.961558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:49.961558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:49.961558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:49.961558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:49.961558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:49.961558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:49.961558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:49.961558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:49.961558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:49.961558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:49.961558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:49.961558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:49.961558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:49.961558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:49.961558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:49.961558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:49.961558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:49.963820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:49.963820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:49.963820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:49.963820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:49.963820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 374/727] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:53:49.966960 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f916a61-04ce-4758-a6c8-70d7f7e88690 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:50.076603 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f916a61-04ce-4758-a6c8-70d7f7e88690 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:50.094929 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d21a79-8026-4afe-9134-a806c1e303a3 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:50.094929 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d21a79-8026-4afe-9134-a806c1e303a3 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:50.094929 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d21a79-8026-4afe-9134-a806c1e303a3 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:50.094929 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 375/728] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:53:50.103460 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8e40c-6004-425a-ad09-c8098ed3294b None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:50.103460 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8e40c-6004-425a-ad09-c8098ed3294b None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:50.103460 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8e40c-6004-425a-ad09-c8098ed3294b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:50.112877 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d3e64-e3b0-45f8-9cac-5db1e9432757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:50.113550 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d3e64-e3b0-45f8-9cac-5db1e9432757 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:50.113831 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d3e64-e3b0-45f8-9cac-5db1e9432757 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:50.114109 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d3e64-e3b0-45f8-9cac-5db1e9432757 None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:50.114887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d3e64-e3b0-45f8-9cac-5db1e9432757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:50.115141 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d3e64-e3b0-45f8-9cac-5db1e9432757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:50.116616 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d3e64-e3b0-45f8-9cac-5db1e9432757 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:50.122098 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-c8f8e40c-6004-425a-ad09-c8098ed3294b None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:50.123598 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-c8f8e40c-6004-425a-ad09-c8098ed3294b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:50.129272 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 354/729] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:50.144864 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d3e64-e3b0-45f8-9cac-5db1e9432757 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:50.270898 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d3e64-e3b0-45f8-9cac-5db1e9432757 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:50.308955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c590cef-b19b-4054-afc2-a91c9f4c129a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:50.310288 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c590cef-b19b-4054-afc2-a91c9f4c129a None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:50.310567 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c590cef-b19b-4054-afc2-a91c9f4c129a None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:50.310837 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c590cef-b19b-4054-afc2-a91c9f4c129a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:50.317696 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c590cef-b19b-4054-afc2-a91c9f4c129a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:50.319553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c590cef-b19b-4054-afc2-a91c9f4c129a None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:50.327745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 376/730] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:50 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:53:50.343113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-9c590cef-b19b-4054-afc2-a91c9f4c129a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:50.343113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:50.343113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:50.343113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:50.343113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:50.343113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:50.343113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:50.343113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:50.343113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:50.343113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:50.343113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:50.343113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:50.343113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:53:50.343113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:53:50.343113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:53:50.344215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:53:50.344215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:50.344215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:50.344215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:50.344215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:50.344215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:50.344215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:50.344215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:50.344215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:50.344215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:50.344215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:50.344215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:50.344215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:50.344215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:50.344215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:50.344215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:50.344215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:50.345119 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:53:50.345119 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:53:50.345119 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:53:50.345119 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:53:50.345119 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:53:50.345119 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:53:50.345119 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:53:50.345119 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:50.347162 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 355/731] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:53:50.351960 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8e40c-6004-425a-ad09-c8098ed3294b None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:50.354858 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c590cef-b19b-4054-afc2-a91c9f4c129a None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:50.472898 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8e40c-6004-425a-ad09-c8098ed3294b None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:50.475846 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c590cef-b19b-4054-afc2-a91c9f4c129a None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:50.506268 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad41eec-d575-45e3-a183-85666b12ef1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:50.507077 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad41eec-d575-45e3-a183-85666b12ef1a None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:50.507409 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad41eec-d575-45e3-a183-85666b12ef1a None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:50.507723 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad41eec-d575-45e3-a183-85666b12ef1a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:50.508378 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad41eec-d575-45e3-a183-85666b12ef1a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:50.509745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad41eec-d575-45e3-a183-85666b12ef1a None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:50.512498 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e1a71-7ad5-49c6-80a8-12ff49d9dcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:50.514033 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e1a71-7ad5-49c6-80a8-12ff49d9dcfa None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:50.514319 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e1a71-7ad5-49c6-80a8-12ff49d9dcfa None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:50.514598 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e1a71-7ad5-49c6-80a8-12ff49d9dcfa None admin] PATH_INFO: `/v3/projects` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:50.515384 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e1a71-7ad5-49c6-80a8-12ff49d9dcfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:50.515725 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e1a71-7ad5-49c6-80a8-12ff49d9dcfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:50.517154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e1a71-7ad5-49c6-80a8-12ff49d9dcfa None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:50.522283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-aad41eec-d575-45e3-a183-85666b12ef1a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 16:53:50.522283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:50.522283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:53:50.522283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:53:50.522283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:53:50.522283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:53:50.522283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:53:50.522283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:50.522283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 16:53:50.522283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:50.522283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:53:50.522283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:50.522283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:50.522283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:50.522283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:50.522283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:50.523183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:50.523183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:50.523183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:50.523183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:50.523183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:50.523183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:50.523183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:50.523183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:53:50.523183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:53:50.523183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:53:50.523183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:53:50.523183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:50.523183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:50.523183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:50.523183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:50.523183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:50.524673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:50.524673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:50.524673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:50.524673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:50.524673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:50.524673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:50.524673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:50.524673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:50.524673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:50.524673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:50.524673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:50.524673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:53:50.524673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:50.524673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 16:53:50.524673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:50.524673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 377/732] 10.222.0.64 () {56 vars in 1129 bytes} [Thu May 12 16:53:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:50.525532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4364521-3b85-4a8e-b9ff-13cc521116ee None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:50.525532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4364521-3b85-4a8e-b9ff-13cc521116ee None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:50.525532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4364521-3b85-4a8e-b9ff-13cc521116ee None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:50.527325 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 378/733] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:50.530364 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4364521-3b85-4a8e-b9ff-13cc521116ee None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:50.534040 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 356/734] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:53:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:50.535338 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3372e2-7f76-4f3a-aeec-590f4178553f None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:50.535617 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3372e2-7f76-4f3a-aeec-590f4178553f None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:50.535927 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3372e2-7f76-4f3a-aeec-590f4178553f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:50.553862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-2d3372e2-7f76-4f3a-aeec-590f4178553f None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:50.555055 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-2d3372e2-7f76-4f3a-aeec-590f4178553f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:50.622097 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 357/735] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:50 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:53:50.623703 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3372e2-7f76-4f3a-aeec-590f4178553f None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:50.644612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4364521-3b85-4a8e-b9ff-13cc521116ee None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:50.678785 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06dd066-9978-47f7-aeec-bbf4a364c85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:50.679575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dd066-9978-47f7-aeec-bbf4a364c85c None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:50.679892 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dd066-9978-47f7-aeec-bbf4a364c85c None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:50.680194 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06dd066-9978-47f7-aeec-bbf4a364c85c None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:50.680894 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06dd066-9978-47f7-aeec-bbf4a364c85c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:50.681199 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06dd066-9978-47f7-aeec-bbf4a364c85c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:50.682570 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06dd066-9978-47f7-aeec-bbf4a364c85c None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:50.692114 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 379/736] 10.222.0.64 () {56 vars in 1124 bytes} [Thu May 12 16:53:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:50.692114 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06dd066-9978-47f7-aeec-bbf4a364c85c None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:50.724653 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3372e2-7f76-4f3a-aeec-590f4178553f None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:50.759086 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bed87-8389-4c96-b610-ea6cf350869e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:50.759778 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bed87-8389-4c96-b610-ea6cf350869e None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:50.760064 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bed87-8389-4c96-b610-ea6cf350869e None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:50.760333 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bed87-8389-4c96-b610-ea6cf350869e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:50.761165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bed87-8389-4c96-b610-ea6cf350869e None admin] RBAC: Adding query filter params (role.id=fbd6364b42a641f695c0b265a789057a, scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff, user.id=cd52d2543a9f4b5d9270a12544b0a021) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:50.761477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bed87-8389-4c96-b610-ea6cf350869e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:50.762967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bed87-8389-4c96-b610-ea6cf350869e None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:50.779671 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 358/737] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:53:50 2022] GET /identity/v3/role_assignments?user.id=cd52d2543a9f4b5d9270a12544b0a021&scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff&role.id=fbd6364b42a641f695c0b265a789057a => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:50.779671 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bed87-8389-4c96-b610-ea6cf350869e None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:50.806177 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06dd066-9978-47f7-aeec-bbf4a364c85c None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:50.860041 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1dd30-d5cd-46cd-8ed9-93cb1b4bb095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:50.861645 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1dd30-d5cd-46cd-8ed9-93cb1b4bb095 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:50.862006 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1dd30-d5cd-46cd-8ed9-93cb1b4bb095 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:50.862355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1dd30-d5cd-46cd-8ed9-93cb1b4bb095 None admin] PATH_INFO: `/v3/services/network` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:50.863101 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1dd30-d5cd-46cd-8ed9-93cb1b4bb095 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:50.864950 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1dd30-d5cd-46cd-8ed9-93cb1b4bb095 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:50.881997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-24b1dd30-d5cd-46cd-8ed9-93cb1b4bb095 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 16:53:50.881997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:50.881997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:53:50.881997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:53:50.881997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:53:50.881997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:53:50.881997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:53:50.881997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:50.881997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 16:53:50.881997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:50.881997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:53:50.881997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:50.881997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:50.881997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:50.881997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:50.881997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:50.881997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:50.883097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:50.883097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:50.883097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:50.883097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:50.883097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:50.883097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:50.883097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:53:50.883097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:53:50.883097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:53:50.883097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:53:50.883097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:50.883097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:50.883097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:50.883097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:50.883097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:50.883097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:50.884257 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:50.884257 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:50.884257 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:50.884257 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:50.884257 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:50.884257 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:50.884257 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:50.884257 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:50.884257 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:50.884257 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:50.884257 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:53:50.884257 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:50.884257 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 16:53:50.884257 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:50.884257 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 380/738] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:53:50 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:50.895677 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1dd30-d5cd-46cd-8ed9-93cb1b4bb095 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:50.903174 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bed87-8389-4c96-b610-ea6cf350869e None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:50.960363 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d17bdf-c7c4-4063-9f11-72f1452080bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:50.961038 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d17bdf-c7c4-4063-9f11-72f1452080bd None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:50.961324 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d17bdf-c7c4-4063-9f11-72f1452080bd None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:50.961701 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d17bdf-c7c4-4063-9f11-72f1452080bd None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:50.963548 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d17bdf-c7c4-4063-9f11-72f1452080bd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:50.963548 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d17bdf-c7c4-4063-9f11-72f1452080bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:50.964555 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d17bdf-c7c4-4063-9f11-72f1452080bd None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:50.975324 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 359/739] 10.222.0.64 () {56 vars in 1124 bytes} [Thu May 12 16:53:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:50.976740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d17bdf-c7c4-4063-9f11-72f1452080bd None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:51.010042 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1dd30-d5cd-46cd-8ed9-93cb1b4bb095 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:51.049749 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbeab44-4f58-4ce0-a49f-101f0a7399ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:51.050417 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbeab44-4f58-4ce0-a49f-101f0a7399ee None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:51.050696 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbeab44-4f58-4ce0-a49f-101f0a7399ee None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:51.050968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbeab44-4f58-4ce0-a49f-101f0a7399ee None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:51.052997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbeab44-4f58-4ce0-a49f-101f0a7399ee None admin] RBAC: Adding query filter params (name=network) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:51.052997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbeab44-4f58-4ce0-a49f-101f0a7399ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:51.053465 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbeab44-4f58-4ce0-a49f-101f0a7399ee None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:51.059249 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 381/740] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 12 16:53:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:51.065391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbeab44-4f58-4ce0-a49f-101f0a7399ee None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:51.104576 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d17bdf-c7c4-4063-9f11-72f1452080bd None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:51.150013 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8fd63-1f47-4676-ba85-9406fe499154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:51.150860 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8fd63-1f47-4676-ba85-9406fe499154 None admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:51.151218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8fd63-1f47-4676-ba85-9406fe499154 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:51.151922 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8fd63-1f47-4676-ba85-9406fe499154 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:51.153037 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8fd63-1f47-4676-ba85-9406fe499154 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:51.155095 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8fd63-1f47-4676-ba85-9406fe499154 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:51.187683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 360/741] 10.222.0.64 () {60 vars in 1144 bytes} [Thu May 12 16:53:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:53:51.198328 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbeab44-4f58-4ce0-a49f-101f0a7399ee None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:51.244418 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48399e71-78bf-46f4-b2ae-6725a3b7d4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:51.245097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48399e71-78bf-46f4-b2ae-6725a3b7d4b0 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:51.245380 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48399e71-78bf-46f4-b2ae-6725a3b7d4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:51.245713 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48399e71-78bf-46f4-b2ae-6725a3b7d4b0 None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:51.246434 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48399e71-78bf-46f4-b2ae-6725a3b7d4b0 None admin] RBAC: Adding query filter params (type=network) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:51.246740 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48399e71-78bf-46f4-b2ae-6725a3b7d4b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:51.248759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48399e71-78bf-46f4-b2ae-6725a3b7d4b0 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:51.254965 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 382/742] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 12 16:53:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:51.260757 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8fd63-1f47-4676-ba85-9406fe499154 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:51.373234 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8fd63-1f47-4676-ba85-9406fe499154 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:51.407131 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afc3df-758f-4060-abc6-2ec791ae1ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:51.407811 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afc3df-758f-4060-abc6-2ec791ae1ff6 None admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:51.408094 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afc3df-758f-4060-abc6-2ec791ae1ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:51.408370 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afc3df-758f-4060-abc6-2ec791ae1ff6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:51.409101 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afc3df-758f-4060-abc6-2ec791ae1ff6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:51.410477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afc3df-758f-4060-abc6-2ec791ae1ff6 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:51.435093 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 361/743] 10.222.0.64 () {60 vars in 1144 bytes} [Thu May 12 16:53:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:53:52.295422 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0d3d0-461a-4871-9d5c-868bc4796200 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:52.295948 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0d3d0-461a-4871-9d5c-868bc4796200 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:52.295948 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0d3d0-461a-4871-9d5c-868bc4796200 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:52.297618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 383/744] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:53:52.302742 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebff0e4-cd4d-4ce4-a89c-49052e9f3310 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:52.303045 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebff0e4-cd4d-4ce4-a89c-49052e9f3310 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:52.303334 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebff0e4-cd4d-4ce4-a89c-49052e9f3310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:52.320392 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-cebff0e4-cd4d-4ce4-a89c-49052e9f3310 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:52.321605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-cebff0e4-cd4d-4ce4-a89c-49052e9f3310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:52.394810 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 362/745] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:52 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:53:52.418383 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0d3d0-461a-4871-9d5c-868bc4796200 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:52.518221 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0d3d0-461a-4871-9d5c-868bc4796200 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:52.551416 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd5c42-ba9c-4cf2-adb5-a7fd74bc860e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:52.552018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd5c42-ba9c-4cf2-adb5-a7fd74bc860e None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:52.552318 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd5c42-ba9c-4cf2-adb5-a7fd74bc860e None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:52.552590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd5c42-ba9c-4cf2-adb5-a7fd74bc860e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:52.615535 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd5c42-ba9c-4cf2-adb5-a7fd74bc860e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:52.617018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd5c42-ba9c-4cf2-adb5-a7fd74bc860e None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:52.720267 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 384/746] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:53:52 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 16:53:52.728752 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebff0e4-cd4d-4ce4-a89c-49052e9f3310 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:52.844928 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebff0e4-cd4d-4ce4-a89c-49052e9f3310 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:52.880941 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430177db-5de0-4f61-aad2-6e43b84e40a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:52.882131 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430177db-5de0-4f61-aad2-6e43b84e40a6 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:52.882627 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430177db-5de0-4f61-aad2-6e43b84e40a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:52.883099 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430177db-5de0-4f61-aad2-6e43b84e40a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:52.894274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430177db-5de0-4f61-aad2-6e43b84e40a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:52.896063 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430177db-5de0-4f61-aad2-6e43b84e40a6 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:52.915218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-430177db-5de0-4f61-aad2-6e43b84e40a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:52.915218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:52.915218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:52.915218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:52.915218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:52.915218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:52.915218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:52.915218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:52.915218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:52.915218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:52.915218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:52.915218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:52.915218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:53:52.915218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:53:52.915218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:53:52.916138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:53:52.916138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:52.916138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:52.916138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:52.916138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:52.916138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:52.916138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:52.916138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:52.916138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:52.916138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:52.916138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:52.916138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:52.916138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:52.916138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:52.916138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:52.916138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:52.916138 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:52.917246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:53:52.917246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:53:52.917246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:53:52.917246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:52.923336 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 363/747] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:52.928991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd5c42-ba9c-4cf2-adb5-a7fd74bc860e None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:53.036764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd5c42-ba9c-4cf2-adb5-a7fd74bc860e None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:53.071746 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084b04d-0929-4952-8cf7-a0f6008f0b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:53.072862 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084b04d-0929-4952-8cf7-a0f6008f0b80 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:53.073344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084b04d-0929-4952-8cf7-a0f6008f0b80 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:53.073868 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084b04d-0929-4952-8cf7-a0f6008f0b80 None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:53.075699 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084b04d-0929-4952-8cf7-a0f6008f0b80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:53.076014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084b04d-0929-4952-8cf7-a0f6008f0b80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:53.077391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084b04d-0929-4952-8cf7-a0f6008f0b80 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:53.088993 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 385/748] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:53.194709 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b33c75-1d96-4b49-9183-49a59623d01a None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:53.195077 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b33c75-1d96-4b49-9183-49a59623d01a None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:53.195268 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b33c75-1d96-4b49-9183-49a59623d01a None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:53.196945 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 364/749] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:53.203286 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272efcc-0110-4428-9778-5579e044fb49 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:53.203586 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272efcc-0110-4428-9778-5579e044fb49 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:53.203902 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272efcc-0110-4428-9778-5579e044fb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:53.221089 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-d272efcc-0110-4428-9778-5579e044fb49 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:53.222413 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-d272efcc-0110-4428-9778-5579e044fb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:53.291539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 386/750] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:53 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:53:53.314730 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b33c75-1d96-4b49-9183-49a59623d01a None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:53.430296 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b33c75-1d96-4b49-9183-49a59623d01a None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:53.463928 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552954e6-b275-4eee-8e74-c84d6f665e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:53.464666 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552954e6-b275-4eee-8e74-c84d6f665e23 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:53.464948 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552954e6-b275-4eee-8e74-c84d6f665e23 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:53.465220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552954e6-b275-4eee-8e74-c84d6f665e23 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:53.465924 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552954e6-b275-4eee-8e74-c84d6f665e23 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:53.467710 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552954e6-b275-4eee-8e74-c84d6f665e23 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:53.480848 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-552954e6-b275-4eee-8e74-c84d6f665e23 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 16:53:53.480848 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:53.480848 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:53:53.480848 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:53:53.480848 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:53:53.480848 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:53:53.480848 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:53:53.480848 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:53.480848 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 16:53:53.480848 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:53.480848 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:53:53.480848 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:53.480848 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:53.480848 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:53.480848 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:53.480848 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:53.481823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:53.481823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:53.481823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:53.481823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:53.481823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:53.481823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:53.481823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:53.481823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:53:53.481823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:53:53.481823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:53:53.481823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:53:53.481823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:53.481823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:53.481823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:53.481823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:53.481823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:53.482640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:53.482640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:53.482640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:53.482640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:53.482640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:53.482640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:53.482640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:53.482640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:53.482640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:53.482640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:53.482640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:53.482640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:53:53.482640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:53.482640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 16:53:53.482640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:53.482640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 365/751] 10.222.0.64 () {56 vars in 1132 bytes} [Thu May 12 16:53:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:53.489035 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272efcc-0110-4428-9778-5579e044fb49 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:53.592549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272efcc-0110-4428-9778-5579e044fb49 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:53.595210 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471b32b-a95d-41a1-baf4-3e2b836eb653 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:53.595501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471b32b-a95d-41a1-baf4-3e2b836eb653 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:53.595835 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471b32b-a95d-41a1-baf4-3e2b836eb653 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:53.597200 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 366/752] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:53:53.602410 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fabd3d-5940-4faa-a3fd-6a27ad94c0ce None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:53.602691 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fabd3d-5940-4faa-a3fd-6a27ad94c0ce None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:53.602975 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fabd3d-5940-4faa-a3fd-6a27ad94c0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:53.619715 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-b1fabd3d-5940-4faa-a3fd-6a27ad94c0ce None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:53.620899 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-b1fabd3d-5940-4faa-a3fd-6a27ad94c0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:53.626026 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a4fe9-91cb-49e9-872a-056abe00ebe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:53.626686 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a4fe9-91cb-49e9-872a-056abe00ebe4 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:53.626967 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a4fe9-91cb-49e9-872a-056abe00ebe4 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:53.627235 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a4fe9-91cb-49e9-872a-056abe00ebe4 None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:53.627970 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a4fe9-91cb-49e9-872a-056abe00ebe4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:53.628274 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a4fe9-91cb-49e9-872a-056abe00ebe4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:53.629630 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144a4fe9-91cb-49e9-872a-056abe00ebe4 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:53.633984 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 387/753] 10.222.0.64 () {56 vars in 1126 bytes} [Thu May 12 16:53:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:53.640532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a4fe9-91cb-49e9-872a-056abe00ebe4 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:53.685381 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 367/754] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:53 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 16:53:53.708469 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fabd3d-5940-4faa-a3fd-6a27ad94c0ce None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:53.733385 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144a4fe9-91cb-49e9-872a-056abe00ebe4 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:53.765389 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fd5bc-91fe-4ebc-8000-0e58ac2da87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:53.766046 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fd5bc-91fe-4ebc-8000-0e58ac2da87d None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:53.766329 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fd5bc-91fe-4ebc-8000-0e58ac2da87d None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:53.766605 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fd5bc-91fe-4ebc-8000-0e58ac2da87d None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:53.767303 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fd5bc-91fe-4ebc-8000-0e58ac2da87d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:53.767608 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fd5bc-91fe-4ebc-8000-0e58ac2da87d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:53.769003 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fd5bc-91fe-4ebc-8000-0e58ac2da87d None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:53.773219 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 388/755] 10.222.0.64 () {56 vars in 1126 bytes} [Thu May 12 16:53:53 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:53.804063 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fabd3d-5940-4faa-a3fd-6a27ad94c0ce None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:53.843069 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5f671-3999-4d9a-b9cb-a13013920e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:53.843943 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5f671-3999-4d9a-b9cb-a13013920e62 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:53.844225 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5f671-3999-4d9a-b9cb-a13013920e62 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:53.844499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5f671-3999-4d9a-b9cb-a13013920e62 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:53.845163 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5f671-3999-4d9a-b9cb-a13013920e62 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:53.846579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5f671-3999-4d9a-b9cb-a13013920e62 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:53.859277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-b9c5f671-3999-4d9a-b9cb-a13013920e62 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 16:53:53.859277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:53.859277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:53:53.859277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:53:53.859277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:53:53.859277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:53:53.859277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:53:53.859277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:53.859277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 16:53:53.859277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:53.859277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:53:53.859277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:53.859277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:53.859277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:53.859277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:53.859277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:53.859277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:53.860526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:53.860526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:53.860526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:53.860526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:53.860526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:53.860526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:53.860526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:53:53.860526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:53:53.860526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:53:53.860526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:53:53.860526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:53.860526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:53.860526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:53.860526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:53.860526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:53.860526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:53.861457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:53.861457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:53.861457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:53.861457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:53.861457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:53.861457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:53.861457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:53.861457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:53.861457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:53.861457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:53.861457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:53:53.861457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:53.861457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 16:53:53.861457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:53.861457 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 368/756] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:53:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:53:53.866931 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fd5bc-91fe-4ebc-8000-0e58ac2da87d None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:53.973152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fd5bc-91fe-4ebc-8000-0e58ac2da87d None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:54.005846 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982004d-f3c3-4652-82d4-734f42744d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:54.006435 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982004d-f3c3-4652-82d4-734f42744d0a None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:54.006734 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982004d-f3c3-4652-82d4-734f42744d0a None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:54.006990 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982004d-f3c3-4652-82d4-734f42744d0a None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:54.007715 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982004d-f3c3-4652-82d4-734f42744d0a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:54.008022 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982004d-f3c3-4652-82d4-734f42744d0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:54.009385 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982004d-f3c3-4652-82d4-734f42744d0a None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:54.014221 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 389/757] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:53:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:54.019844 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5f671-3999-4d9a-b9cb-a13013920e62 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:54.233041 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5f671-3999-4d9a-b9cb-a13013920e62 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:54.265159 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2f9bc-5526-4e59-8a37-6837e8308fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:54.265743 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2f9bc-5526-4e59-8a37-6837e8308fc7 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:54.266020 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2f9bc-5526-4e59-8a37-6837e8308fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:54.266291 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2f9bc-5526-4e59-8a37-6837e8308fc7 None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:54.266984 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2f9bc-5526-4e59-8a37-6837e8308fc7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:54.267282 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2f9bc-5526-4e59-8a37-6837e8308fc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:54.268651 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2f9bc-5526-4e59-8a37-6837e8308fc7 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:54.272904 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 369/758] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:53:54 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:56.065425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccea12-5b2d-40d1-ad9f-9bf3e201d224 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:56.066005 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccea12-5b2d-40d1-ad9f-9bf3e201d224 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:56.066219 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccea12-5b2d-40d1-ad9f-9bf3e201d224 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:56.067560 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 390/759] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:56.073067 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baff7f-aaef-4804-ba7c-9442d3e72ee4 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:56.073481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baff7f-aaef-4804-ba7c-9442d3e72ee4 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:56.073691 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baff7f-aaef-4804-ba7c-9442d3e72ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:56.089888 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-23baff7f-aaef-4804-ba7c-9442d3e72ee4 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:56.091089 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-23baff7f-aaef-4804-ba7c-9442d3e72ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:56.154050 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 370/760] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:56 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:53:56.177737 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccea12-5b2d-40d1-ad9f-9bf3e201d224 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:56.296086 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccea12-5b2d-40d1-ad9f-9bf3e201d224 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:56.329495 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc06d44-cfaa-4afb-b328-a12d96d9985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:56.330171 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc06d44-cfaa-4afb-b328-a12d96d9985b None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:56.330449 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc06d44-cfaa-4afb-b328-a12d96d9985b None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:56.330720 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc06d44-cfaa-4afb-b328-a12d96d9985b None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:56.331465 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc06d44-cfaa-4afb-b328-a12d96d9985b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:56.332930 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc06d44-cfaa-4afb-b328-a12d96d9985b None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:56.347281 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 391/761] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 12 16:53:56 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:53:56.511472 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60029582-ba61-456f-94ce-0e79bff62509 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:56.511793 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60029582-ba61-456f-94ce-0e79bff62509 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:56.512073 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60029582-ba61-456f-94ce-0e79bff62509 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:56.513971 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 371/762] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:56.519654 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10edc-3a84-49d3-8bd6-441a876f70e6 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:56.520040 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10edc-3a84-49d3-8bd6-441a876f70e6 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:56.520378 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca10edc-3a84-49d3-8bd6-441a876f70e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:56.537612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-bca10edc-3a84-49d3-8bd6-441a876f70e6 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:56.538792 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-bca10edc-3a84-49d3-8bd6-441a876f70e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:56.612823 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 392/763] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:56 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:53:56.636040 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60029582-ba61-456f-94ce-0e79bff62509 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:56.732039 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60029582-ba61-456f-94ce-0e79bff62509 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:56.763812 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df7bbc-8dde-4014-981c-2ce2df7fa989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:56.764402 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df7bbc-8dde-4014-981c-2ce2df7fa989 None admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:56.764680 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df7bbc-8dde-4014-981c-2ce2df7fa989 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:56.764950 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df7bbc-8dde-4014-981c-2ce2df7fa989 None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:56.765669 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df7bbc-8dde-4014-981c-2ce2df7fa989 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:56.767019 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df7bbc-8dde-4014-981c-2ce2df7fa989 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:56.781608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 372/764] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 12 16:53:56 2022] POST /identity/v3/services => generated 251 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:53:58.625417 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099040e-85a8-4431-879f-0633b53fb9f5 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:58.625945 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099040e-85a8-4431-879f-0633b53fb9f5 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:58.626032 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0099040e-85a8-4431-879f-0633b53fb9f5 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:58.627340 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 393/765] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:53:58.632603 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78432e-d77b-445d-89c9-28cf7340167c None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:58.633023 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78432e-d77b-445d-89c9-28cf7340167c None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:58.633288 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78432e-d77b-445d-89c9-28cf7340167c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:58.650030 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-9b78432e-d77b-445d-89c9-28cf7340167c None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:58.651204 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-9b78432e-d77b-445d-89c9-28cf7340167c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:58.719914 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 373/766] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:58 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:53:58.743674 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099040e-85a8-4431-879f-0633b53fb9f5 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:58.837287 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0099040e-85a8-4431-879f-0633b53fb9f5 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:58.874809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7cd86-dfe5-4902-b548-e88fb4b404a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:58.875725 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7cd86-dfe5-4902-b548-e88fb4b404a0 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:58.875949 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7cd86-dfe5-4902-b548-e88fb4b404a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:58.876220 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7cd86-dfe5-4902-b548-e88fb4b404a0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:58.876891 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7cd86-dfe5-4902-b548-e88fb4b404a0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:58.878300 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7cd86-dfe5-4902-b548-e88fb4b404a0 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:58.891703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-85c7cd86-dfe5-4902-b548-e88fb4b404a0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 16:53:58.891703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:58.891703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:53:58.891703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:53:58.891703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:53:58.891703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:53:58.891703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:53:58.891703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:58.891703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 16:53:58.891703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:58.891703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:53:58.891703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:58.891703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:58.891703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:58.891703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:58.891703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:58.892745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:58.892745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:58.892745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:58.892745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:58.892745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:58.892745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:58.892745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:58.892745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:53:58.892745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:53:58.892745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:53:58.892745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:53:58.892745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:58.892745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:58.892745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:58.892745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:58.892745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:58.893562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:58.893562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:58.893562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:53:58.893562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:58.893562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:58.893562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:58.893562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:58.893562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:58.893562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:58.893562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:58.893562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:58.893562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:53:58.893562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:58.893562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 16:53:58.893562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:53:58.893562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 394/767] 10.222.0.64 () {56 vars in 1132 bytes} [Thu May 12 16:53:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:53:58.900074 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78432e-d77b-445d-89c9-28cf7340167c None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:58.995115 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78432e-d77b-445d-89c9-28cf7340167c None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:59.026929 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a115c-3770-468e-b44c-57f5a3e4937c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:59.027589 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a115c-3770-468e-b44c-57f5a3e4937c None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:59.028672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a115c-3770-468e-b44c-57f5a3e4937c None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:59.028783 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a115c-3770-468e-b44c-57f5a3e4937c None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:59.029415 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a115c-3770-468e-b44c-57f5a3e4937c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:59.029720 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a115c-3770-468e-b44c-57f5a3e4937c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:59.031083 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a115c-3770-468e-b44c-57f5a3e4937c None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:59.035625 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 374/768] 10.222.0.64 () {56 vars in 1126 bytes} [Thu May 12 16:53:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:59.041221 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7cd86-dfe5-4902-b548-e88fb4b404a0 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:59.059461 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de88ba6-0285-477b-a755-9a2d107cabd5 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:59.059905 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de88ba6-0285-477b-a755-9a2d107cabd5 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:59.060184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de88ba6-0285-477b-a755-9a2d107cabd5 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:59.061518 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 375/769] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:53:59.066334 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75b310-3f08-44ba-b54c-3759cb52cee5 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:59.066615 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75b310-3f08-44ba-b54c-3759cb52cee5 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:59.066888 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75b310-3f08-44ba-b54c-3759cb52cee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:59.083031 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-bc75b310-3f08-44ba-b54c-3759cb52cee5 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:53:59.084225 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-bc75b310-3f08-44ba-b54c-3759cb52cee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:53:59.134766 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7cd86-dfe5-4902-b548-e88fb4b404a0 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:59.146711 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 376/770] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:53:59 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 16:53:59.166839 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969363d2-95b6-491f-90c7-480362aa7c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:59.167497 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969363d2-95b6-491f-90c7-480362aa7c5b None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:59.167820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969363d2-95b6-491f-90c7-480362aa7c5b None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:59.168103 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969363d2-95b6-491f-90c7-480362aa7c5b None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:59.168806 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969363d2-95b6-491f-90c7-480362aa7c5b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:59.169117 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969363d2-95b6-491f-90c7-480362aa7c5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:59.170483 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969363d2-95b6-491f-90c7-480362aa7c5b None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:59.170642 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75b310-3f08-44ba-b54c-3759cb52cee5 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:59.175250 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 395/771] 10.222.0.64 () {56 vars in 1126 bytes} [Thu May 12 16:53:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:53:59.180939 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969363d2-95b6-491f-90c7-480362aa7c5b None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:59.264103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75b310-3f08-44ba-b54c-3759cb52cee5 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:59.274184 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969363d2-95b6-491f-90c7-480362aa7c5b None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:59.295128 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3309a3a-4338-4063-be04-09507926c28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:59.295950 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3309a3a-4338-4063-be04-09507926c28d None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:59.296228 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3309a3a-4338-4063-be04-09507926c28d None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:59.296496 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3309a3a-4338-4063-be04-09507926c28d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:59.297157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3309a3a-4338-4063-be04-09507926c28d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:59.298510 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3309a3a-4338-4063-be04-09507926c28d None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:59.308968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40786e-5536-45c5-9622-4ce2edf76df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:59.310410 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40786e-5536-45c5-9622-4ce2edf76df1 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:59.310626 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-d3309a3a-4338-4063-be04-09507926c28d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 16:53:59.310626 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:59.310626 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:53:59.310626 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:53:59.310626 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:53:59.310626 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:53:59.310626 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:53:59.310626 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:59.310626 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 16:53:59.310626 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:59.310626 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:53:59.310626 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:59.310626 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:53:59.310626 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:53:59.310626 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:53:59.310626 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:53:59.310626 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:53:59.311693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:53:59.311693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:53:59.311693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:53:59.311693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:53:59.311693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:53:59.311693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:53:59.311693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:53:59.311693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:53:59.311693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:53:59.311693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:53:59.311693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:53:59.311693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:53:59.311693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:53:59.311693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:53:59.311693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:53:59.311693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:53:59.312712 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:53:59.312712 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:53:59.312712 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:53:59.312712 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:53:59.312712 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:53:59.312712 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:53:59.312712 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:53:59.312712 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:53:59.312712 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:53:59.312712 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:53:59.312712 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:53:59.312712 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:53:59.312712 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 16:53:59.312712 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:53:59.313672 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40786e-5536-45c5-9622-4ce2edf76df1 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:59.313672 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40786e-5536-45c5-9622-4ce2edf76df1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:59.313808 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 377/772] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:53:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:53:59.314411 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40786e-5536-45c5-9622-4ce2edf76df1 None admin] RBAC: Adding query filter params (interface=public, service_id=02aee20eaba8417c86f16e96bb230e4e, region_id=RegionOne) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:59.314763 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40786e-5536-45c5-9622-4ce2edf76df1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:59.317189 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40786e-5536-45c5-9622-4ce2edf76df1 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:59.317865 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3309a3a-4338-4063-be04-09507926c28d None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:59.328838 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 396/773] 10.222.0.64 () {56 vars in 1251 bytes} [Thu May 12 16:53:59 2022] GET /identity/v3/endpoints?service_id=02aee20eaba8417c86f16e96bb230e4e&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:59.329893 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40786e-5536-45c5-9622-4ce2edf76df1 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:59.410302 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3309a3a-4338-4063-be04-09507926c28d None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:59.420509 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40786e-5536-45c5-9622-4ce2edf76df1 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:59.441245 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810aad6-3342-4b6b-830d-87c7cda677c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:59.441893 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810aad6-3342-4b6b-830d-87c7cda677c0 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:59.442176 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810aad6-3342-4b6b-830d-87c7cda677c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:59.442441 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810aad6-3342-4b6b-830d-87c7cda677c0 None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:59.443135 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810aad6-3342-4b6b-830d-87c7cda677c0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:59.443436 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810aad6-3342-4b6b-830d-87c7cda677c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:59.444824 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810aad6-3342-4b6b-830d-87c7cda677c0 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:59.449357 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 378/774] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:53:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:59.452545 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a676ddd-3ad3-491b-b005-bf10c636a3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:59.453198 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a676ddd-3ad3-491b-b005-bf10c636a3cd None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:59.453476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a676ddd-3ad3-491b-b005-bf10c636a3cd None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:59.453747 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a676ddd-3ad3-491b-b005-bf10c636a3cd None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:59.454418 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a676ddd-3ad3-491b-b005-bf10c636a3cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:59.455394 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810aad6-3342-4b6b-830d-87c7cda677c0 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:59.455796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a676ddd-3ad3-491b-b005-bf10c636a3cd None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:59.461499 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 397/775] 10.222.0.64 () {56 vars in 1087 bytes} [Thu May 12 16:53:59 2022] GET /identity/v3/services => generated 1498 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:53:59.554932 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810aad6-3342-4b6b-830d-87c7cda677c0 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:59.588849 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bb91c-f66c-4583-87ab-96a338940439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:59.589527 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bb91c-f66c-4583-87ab-96a338940439 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:59.589805 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bb91c-f66c-4583-87ab-96a338940439 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:59.590272 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bb91c-f66c-4583-87ab-96a338940439 None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:59.591001 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bb91c-f66c-4583-87ab-96a338940439 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:59.591303 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bb91c-f66c-4583-87ab-96a338940439 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:59.592740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bb91c-f66c-4583-87ab-96a338940439 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:59.598870 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 379/776] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:53:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:59.605467 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a676ddd-3ad3-491b-b005-bf10c636a3cd None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:59.707297 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a676ddd-3ad3-491b-b005-bf10c636a3cd None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:59.738710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd42c6-11c2-47ad-946e-4ea83062b87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:59.739363 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd42c6-11c2-47ad-946e-4ea83062b87c None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:59.739662 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd42c6-11c2-47ad-946e-4ea83062b87c None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:59.739946 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd42c6-11c2-47ad-946e-4ea83062b87c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:59.740736 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd42c6-11c2-47ad-946e-4ea83062b87c None admin] RBAC: Adding query filter params (interface=public, service_id=220b3a3df6134b84897a3732b69e7042, region_id=RegionOne) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:53:59.741046 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd42c6-11c2-47ad-946e-4ea83062b87c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:59.742437 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd42c6-11c2-47ad-946e-4ea83062b87c None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:59.747788 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 398/777] 10.222.0.64 () {56 vars in 1251 bytes} [Thu May 12 16:53:59 2022] GET /identity/v3/endpoints?service_id=220b3a3df6134b84897a3732b69e7042&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:53:59.753307 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bb91c-f66c-4583-87ab-96a338940439 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:53:59.846878 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bb91c-f66c-4583-87ab-96a338940439 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:53:59.884585 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5781d-2dcc-4a0f-b33e-86c8a7d69da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:53:59.885241 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5781d-2dcc-4a0f-b33e-86c8a7d69da3 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:53:59.885518 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5781d-2dcc-4a0f-b33e-86c8a7d69da3 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:53:59.885792 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5781d-2dcc-4a0f-b33e-86c8a7d69da3 None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:53:59.886458 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5781d-2dcc-4a0f-b33e-86c8a7d69da3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:53:59.887838 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5781d-2dcc-4a0f-b33e-86c8a7d69da3 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:53:59.893614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 380/778] 10.222.0.64 () {56 vars in 1087 bytes} [Thu May 12 16:53:59 2022] GET /identity/v3/services => generated 1498 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:54:01.742180 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125089d-a74a-4eb5-9464-7e6b7b905bbd None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:01.742752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125089d-a74a-4eb5-9464-7e6b7b905bbd None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:01.742752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125089d-a74a-4eb5-9464-7e6b7b905bbd None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:01.744121 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 399/779] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:54:01.749347 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8c045-82da-4ce9-91b8-13472b899a5d None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:01.749780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8c045-82da-4ce9-91b8-13472b899a5d None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:01.749910 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8c045-82da-4ce9-91b8-13472b899a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:01.766839 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-20c8c045-82da-4ce9-91b8-13472b899a5d None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:54:01.768059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-20c8c045-82da-4ce9-91b8-13472b899a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:54:01.831275 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 381/780] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:54:01 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:54:01.855694 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125089d-a74a-4eb5-9464-7e6b7b905bbd None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:01.954270 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125089d-a74a-4eb5-9464-7e6b7b905bbd None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:01.992558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218310ab-e24c-409c-beb7-f5f2fea36dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:01.993277 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218310ab-e24c-409c-beb7-f5f2fea36dd7 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:01.993550 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218310ab-e24c-409c-beb7-f5f2fea36dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:01.993817 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218310ab-e24c-409c-beb7-f5f2fea36dd7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:01.994479 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218310ab-e24c-409c-beb7-f5f2fea36dd7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:01.995861 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218310ab-e24c-409c-beb7-f5f2fea36dd7 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:02.008107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-218310ab-e24c-409c-beb7-f5f2fea36dd7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 16:54:02.008107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:54:02.008107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:54:02.008107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:54:02.008107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:54:02.008107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:54:02.008107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:54:02.008107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:54:02.008107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 16:54:02.008107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:02.008107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:54:02.008107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:02.008107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:54:02.008107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:54:02.008107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:54:02.008107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:54:02.009084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:54:02.009084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:54:02.009084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:54:02.009084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:54:02.009084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:54:02.009084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:54:02.009084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:54:02.009084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:54:02.009084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:54:02.009084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:54:02.009084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:54:02.009084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:54:02.009084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:54:02.009084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:54:02.009084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:54:02.009084 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:54:02.009910 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:54:02.009910 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:54:02.009910 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:54:02.009910 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:54:02.009910 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:54:02.009910 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:54:02.009910 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:54:02.009910 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:54:02.009910 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:54:02.009910 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:54:02.009910 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:54:02.009910 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:54:02.009910 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:54:02.009910 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 16:54:02.009910 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:02.009910 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 400/781] 10.222.0.64 () {56 vars in 1132 bytes} [Thu May 12 16:54:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:54:02.016406 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8c045-82da-4ce9-91b8-13472b899a5d None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:02.111517 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8c045-82da-4ce9-91b8-13472b899a5d None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:02.143642 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1657fb-a25d-4552-bd09-f91cbf3afd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:02.144321 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1657fb-a25d-4552-bd09-f91cbf3afd0e None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:02.144607 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1657fb-a25d-4552-bd09-f91cbf3afd0e None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:02.144885 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1657fb-a25d-4552-bd09-f91cbf3afd0e None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:02.145589 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1657fb-a25d-4552-bd09-f91cbf3afd0e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:54:02.145893 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1657fb-a25d-4552-bd09-f91cbf3afd0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:02.147264 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1657fb-a25d-4552-bd09-f91cbf3afd0e None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:02.151784 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 382/782] 10.222.0.64 () {56 vars in 1126 bytes} [Thu May 12 16:54:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:54:02.158247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218310ab-e24c-409c-beb7-f5f2fea36dd7 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:02.165805 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e3462-922d-4fc5-96d5-d984a8dbb8f7 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:02.166089 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e3462-922d-4fc5-96d5-d984a8dbb8f7 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:02.166365 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e3462-922d-4fc5-96d5-d984a8dbb8f7 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:02.167716 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 383/783] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:54:02.172563 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76fb00-ff73-4f5b-a806-62d628304a23 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:02.172844 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76fb00-ff73-4f5b-a806-62d628304a23 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:02.173117 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76fb00-ff73-4f5b-a806-62d628304a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:02.189855 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-7d76fb00-ff73-4f5b-a806-62d628304a23 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:54:02.191029 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-7d76fb00-ff73-4f5b-a806-62d628304a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:54:02.252791 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 384/784] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:54:02 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 16:54:02.253643 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218310ab-e24c-409c-beb7-f5f2fea36dd7 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:02.275948 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76fb00-ff73-4f5b-a806-62d628304a23 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:02.285853 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f43e10-66b8-4187-8f20-1ffd2560c6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:02.286510 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f43e10-66b8-4187-8f20-1ffd2560c6f5 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:02.286792 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f43e10-66b8-4187-8f20-1ffd2560c6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:02.287066 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f43e10-66b8-4187-8f20-1ffd2560c6f5 None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:02.287874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f43e10-66b8-4187-8f20-1ffd2560c6f5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:54:02.288182 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f43e10-66b8-4187-8f20-1ffd2560c6f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:02.289557 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f43e10-66b8-4187-8f20-1ffd2560c6f5 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:02.294472 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 401/785] 10.222.0.64 () {56 vars in 1126 bytes} [Thu May 12 16:54:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:54:02.299918 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f43e10-66b8-4187-8f20-1ffd2560c6f5 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:02.376088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76fb00-ff73-4f5b-a806-62d628304a23 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:02.407946 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec86e51-3aff-4db7-8067-78fb5f4e3145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:02.408737 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec86e51-3aff-4db7-8067-78fb5f4e3145 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:02.409016 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec86e51-3aff-4db7-8067-78fb5f4e3145 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:02.409290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec86e51-3aff-4db7-8067-78fb5f4e3145 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:02.409936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec86e51-3aff-4db7-8067-78fb5f4e3145 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:02.411293 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec86e51-3aff-4db7-8067-78fb5f4e3145 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:02.418122 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f43e10-66b8-4187-8f20-1ffd2560c6f5 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:02.422536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-9ec86e51-3aff-4db7-8067-78fb5f4e3145 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 16:54:02.422536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:54:02.422536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:54:02.422536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:54:02.422536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:54:02.422536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:54:02.422536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:54:02.422536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:54:02.422536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 16:54:02.422536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:54:02.422536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:54:02.422536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:54:02.422536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:54:02.422536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:54:02.422536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:54:02.422536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:54:02.422536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:54:02.423508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:54:02.423508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:54:02.423508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:54:02.423508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:54:02.423508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:54:02.423508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:54:02.423508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:54:02.423508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:54:02.423508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:54:02.423508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:54:02.423508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:54:02.423508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:54:02.423508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:54:02.423508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:54:02.423508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:54:02.423508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:54:02.424403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:54:02.424403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:54:02.424403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:54:02.424403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:54:02.424403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:54:02.424403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:54:02.424403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:54:02.424403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:54:02.424403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:54:02.424403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:54:02.424403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:54:02.424403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:54:02.424403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 16:54:02.424403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:54:02.427786 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 385/786] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:54:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:54:02.429599 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec86e51-3aff-4db7-8067-78fb5f4e3145 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:02.450992 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea94bd-2aaa-4f6c-8e98-751d1f2633d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:02.451658 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea94bd-2aaa-4f6c-8e98-751d1f2633d6 None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:02.451954 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea94bd-2aaa-4f6c-8e98-751d1f2633d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:02.452225 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea94bd-2aaa-4f6c-8e98-751d1f2633d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:02.452960 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea94bd-2aaa-4f6c-8e98-751d1f2633d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:02.454315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea94bd-2aaa-4f6c-8e98-751d1f2633d6 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:02.473150 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 402/787] 10.222.0.64 () {60 vars in 1144 bytes} [Thu May 12 16:54:02 2022] POST /identity/v3/endpoints => generated 347 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 16:54:02.529060 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec86e51-3aff-4db7-8067-78fb5f4e3145 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:02.570529 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b7ed2-d0b4-4af4-829b-997c30df1a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:02.571199 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b7ed2-d0b4-4af4-829b-997c30df1a3b None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:02.571481 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b7ed2-d0b4-4af4-829b-997c30df1a3b None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:02.571793 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b7ed2-d0b4-4af4-829b-997c30df1a3b None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:02.572533 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b7ed2-d0b4-4af4-829b-997c30df1a3b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:54:02.572840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b7ed2-d0b4-4af4-829b-997c30df1a3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:02.574244 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b7ed2-d0b4-4af4-829b-997c30df1a3b None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:02.579440 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 386/788] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:54:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:54:02.585410 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea94bd-2aaa-4f6c-8e98-751d1f2633d6 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:02.695485 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea94bd-2aaa-4f6c-8e98-751d1f2633d6 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:02.732121 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37a22a-c77a-4fc7-8f23-bb311ecd9fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:02.732796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37a22a-c77a-4fc7-8f23-bb311ecd9fd6 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:02.733081 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37a22a-c77a-4fc7-8f23-bb311ecd9fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:02.733358 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37a22a-c77a-4fc7-8f23-bb311ecd9fd6 None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:02.734062 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37a22a-c77a-4fc7-8f23-bb311ecd9fd6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:54:02.734371 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37a22a-c77a-4fc7-8f23-bb311ecd9fd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:02.735764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37a22a-c77a-4fc7-8f23-bb311ecd9fd6 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:02.740382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 403/789] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 12 16:54:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:54:02.745850 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b7ed2-d0b4-4af4-829b-997c30df1a3b None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:02.843237 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b7ed2-d0b4-4af4-829b-997c30df1a3b None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:02.878999 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74435f99-ea29-4d91-800b-a7b933bd3ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:02.879687 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74435f99-ea29-4d91-800b-a7b933bd3ddf None admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:02.879977 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74435f99-ea29-4d91-800b-a7b933bd3ddf None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:02.880254 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74435f99-ea29-4d91-800b-a7b933bd3ddf None admin] PATH_INFO: `/v3/endpoints` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:02.881018 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74435f99-ea29-4d91-800b-a7b933bd3ddf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:02.882383 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74435f99-ea29-4d91-800b-a7b933bd3ddf None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:02.900779 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 387/790] 10.222.0.64 () {60 vars in 1144 bytes} [Thu May 12 16:54:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:54:04.792858 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4528e-1b75-4c92-8c57-3882cb364d60 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:04.793460 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4528e-1b75-4c92-8c57-3882cb364d60 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:04.793460 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4528e-1b75-4c92-8c57-3882cb364d60 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:04.794751 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 404/791] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:54:04.800036 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818e824-e634-45a0-b4ad-9bcbe4ba3b45 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:04.800459 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818e824-e634-45a0-b4ad-9bcbe4ba3b45 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:04.800722 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818e824-e634-45a0-b4ad-9bcbe4ba3b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:04.816985 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-3818e824-e634-45a0-b4ad-9bcbe4ba3b45 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:54:04.818162 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-3818e824-e634-45a0-b4ad-9bcbe4ba3b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:54:04.888353 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 388/792] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:54:04 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 16:54:04.913203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4528e-1b75-4c92-8c57-3882cb364d60 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:05.009284 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4528e-1b75-4c92-8c57-3882cb364d60 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:05.044388 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19aa62d-3646-4576-88ab-b49d21bda4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:05.045104 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aa62d-3646-4576-88ab-b49d21bda4a8 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:05.045384 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aa62d-3646-4576-88ab-b49d21bda4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:05.045718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aa62d-3646-4576-88ab-b49d21bda4a8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:05.046385 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19aa62d-3646-4576-88ab-b49d21bda4a8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:05.047783 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19aa62d-3646-4576-88ab-b49d21bda4a8 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:05.059248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-f19aa62d-3646-4576-88ab-b49d21bda4a8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 16:54:05.059248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:54:05.059248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:54:05.059248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:54:05.059248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:54:05.059248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:54:05.059248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:54:05.059248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:54:05.059248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 16:54:05.059248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:05.059248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:54:05.059248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:05.059248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:54:05.059248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:54:05.059248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:54:05.059248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:54:05.059248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:54:05.060487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:54:05.060487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:54:05.060487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:54:05.060487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:54:05.060487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:54:05.060487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:54:05.060487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:54:05.060487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:54:05.060487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:54:05.060487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:54:05.060487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:54:05.060487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:54:05.060487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:54:05.060487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:54:05.060487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:54:05.060487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:54:05.061770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:54:05.061770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:54:05.061770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:54:05.061770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:54:05.061770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:54:05.061770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:54:05.061770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:54:05.061770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:54:05.061770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:54:05.061770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:54:05.061770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:54:05.061770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:54:05.061770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 16:54:05.061770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:05.061770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 405/793] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:54:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:54:05.066388 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818e824-e634-45a0-b4ad-9bcbe4ba3b45 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:05.160008 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818e824-e634-45a0-b4ad-9bcbe4ba3b45 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:05.192079 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1d279-4684-469e-b9d3-a43b58d0b721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:05.192741 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1d279-4684-469e-b9d3-a43b58d0b721 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:05.193026 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1d279-4684-469e-b9d3-a43b58d0b721 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:05.193304 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1d279-4684-469e-b9d3-a43b58d0b721 None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:05.194004 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1d279-4684-469e-b9d3-a43b58d0b721 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:54:05.194311 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1d279-4684-469e-b9d3-a43b58d0b721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:05.195703 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1d279-4684-469e-b9d3-a43b58d0b721 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:05.196622 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f6c3f-263d-486e-a5ba-0238b986de2f None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:05.196913 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f6c3f-263d-486e-a5ba-0238b986de2f None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:05.197190 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f6c3f-263d-486e-a5ba-0238b986de2f None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:05.198550 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 406/794] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:54:05.205364 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 389/795] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 12 16:54:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:54:05.205515 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaa635-9d1b-49ce-9ef2-bfd2769e2503 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:05.205515 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaa635-9d1b-49ce-9ef2-bfd2769e2503 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:05.205515 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaa635-9d1b-49ce-9ef2-bfd2769e2503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:05.206792 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1d279-4684-469e-b9d3-a43b58d0b721 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:05.220676 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-c7aaa635-9d1b-49ce-9ef2-bfd2769e2503 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:54:05.221847 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-c7aaa635-9d1b-49ce-9ef2-bfd2769e2503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:54:05.283442 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 407/796] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:54:05 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:54:05.299252 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1d279-4684-469e-b9d3-a43b58d0b721 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:05.307542 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aaa635-9d1b-49ce-9ef2-bfd2769e2503 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:05.333178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b2ce4-b363-4798-a381-91e1d99f6274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:05.333840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b2ce4-b363-4798-a381-91e1d99f6274 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:05.334119 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b2ce4-b363-4798-a381-91e1d99f6274 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:05.334392 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b2ce4-b363-4798-a381-91e1d99f6274 None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:05.335090 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b2ce4-b363-4798-a381-91e1d99f6274 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:54:05.335398 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b2ce4-b363-4798-a381-91e1d99f6274 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:05.336779 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b2ce4-b363-4798-a381-91e1d99f6274 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:05.341121 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 390/797] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 12 16:54:05 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:54:05.407659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aaa635-9d1b-49ce-9ef2-bfd2769e2503 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:05.442184 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6acbd-5186-4446-840e-e5271d57e8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:05.442846 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6acbd-5186-4446-840e-e5271d57e8f0 None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:05.443122 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6acbd-5186-4446-840e-e5271d57e8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:05.443393 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6acbd-5186-4446-840e-e5271d57e8f0 None admin] PATH_INFO: `/v3/projects` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:05.444124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6acbd-5186-4446-840e-e5271d57e8f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:05.445571 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6acbd-5186-4446-840e-e5271d57e8f0 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:05.446945 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: WARNING keystone.server.flask.common [None req-94d6acbd-5186-4446-840e-e5271d57e8f0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 12 16:54:05.465089 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.sql.core [None req-94d6acbd-5186-4446-840e-e5271d57e8f0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 16:54:05.465089 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 16:54:05.465089 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [parameters: {'id': '37781927c18c4736becc8c53fd46c851', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 16:54:05.465089 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86673) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 16:54:05.481944 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-94d6acbd-5186-4446-840e-e5271d57e8f0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 37781927c18c4736becc8c53fd46c851.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 37781927c18c4736becc8c53fd46c851. May 12 16:54:05.481944 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:54:05.481944 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 16:54:05.481944 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 16:54:05.481944 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 16:54:05.481944 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 16:54:05.481944 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 16:54:05.481944 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application result = self._query(query) May 12 16:54:05.481944 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 16:54:05.481944 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application conn.query(q) May 12 16:54:05.481944 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 16:54:05.481944 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 16:54:05.481944 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 16:54:05.483011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application result.read() May 12 16:54:05.483011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 16:54:05.483011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 16:54:05.483011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 16:54:05.483011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 16:54:05.483011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 16:54:05.483011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 16:54:05.483011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 16:54:05.483011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 16:54:05.483011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 16:54:05.483011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:05.483011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 16:54:05.483011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:05.483011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:54:05.483011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 16:54:05.483011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 16:54:05.483011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 12 16:54:05.483011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return project_ref.to_dict() May 12 16:54:05.489055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 16:54:05.489055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application next(self.gen) May 12 16:54:05.489055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 16:54:05.489055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application yield resource May 12 16:54:05.489055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 16:54:05.489055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application next(self.gen) May 12 16:54:05.489055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 16:54:05.489055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self.session.rollback() May 12 16:54:05.489055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 16:54:05.489055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self.force_reraise() May 12 16:54:05.489055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 16:54:05.489055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise self.value May 12 16:54:05.489055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 16:54:05.489055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 16:54:05.489055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 16:54:05.489055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application session.commit() May 12 16:54:05.489055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 16:54:05.490024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 16:54:05.490024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 16:54:05.490024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._prepare_impl() May 12 16:54:05.490024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 16:54:05.490024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self.session.flush() May 12 16:54:05.490024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 16:54:05.490024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._flush(objects) May 12 16:54:05.490024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 16:54:05.490024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 16:54:05.490024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 16:54:05.490024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application compat.raise_( May 12 16:54:05.490024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 16:54:05.490024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception May 12 16:54:05.490024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 16:54:05.490024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application flush_context.execute() May 12 16:54:05.490024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 16:54:05.490024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rec.execute(self) May 12 16:54:05.490986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 16:54:05.490986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 16:54:05.490986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 16:54:05.490986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 16:54:05.490986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 12 16:54:05.490986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application c = connection._execute_20( May 12 16:54:05.490986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 16:54:05.490986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 16:54:05.490986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 16:54:05.490986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 16:54:05.490986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 16:54:05.490986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 16:54:05.490986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 16:54:05.490986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 16:54:05.490986 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 16:54:05.491874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 16:54:05.491874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 16:54:05.491874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception May 12 16:54:05.491874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 16:54:05.491874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 16:54:05.491874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 16:54:05.491874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 16:54:05.491874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 16:54:05.491874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application result = self._query(query) May 12 16:54:05.491874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 16:54:05.491874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application conn.query(q) May 12 16:54:05.491874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 16:54:05.491874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 16:54:05.491874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 16:54:05.491874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application result.read() May 12 16:54:05.491874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 16:54:05.491874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 16:54:05.492788 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 16:54:05.492788 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 16:54:05.492788 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 16:54:05.492788 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 16:54:05.492788 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 16:54:05.492788 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 16:54:05.492788 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 16:54:05.492788 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 16:54:05.492788 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [parameters: {'id': '37781927c18c4736becc8c53fd46c851', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 16:54:05.492788 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 16:54:05.492788 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:05.492788 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:54:05.492788 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:05.492788 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:54:05.492788 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 12 16:54:05.493590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 12 16:54:05.493590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 16:54:05.493590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 16:54:05.493590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 12 16:54:05.493590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:05.493590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:54:05.493590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:05.493590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:54:05.493590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:54:05.493590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:54:05.493590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:54:05.493590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:54:05.493590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:54:05.493590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:54:05.493590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:54:05.493590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:54:05.493590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:54:05.494543 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:54:05.494543 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 12 16:54:05.494543 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 12 16:54:05.494543 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:54:05.494543 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:54:05.494543 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 12 16:54:05.494543 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.Conflict( May 12 16:54:05.494543 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 37781927c18c4736becc8c53fd46c851. May 12 16:54:05.494543 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:05.494543 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 408/798] 10.222.0.64 () {60 vars in 1140 bytes} [Thu May 12 16:54:05 2022] POST /identity/v3/projects => generated 262 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 12 16:54:05.495182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b2ce4-b363-4798-a381-91e1d99f6274 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:05.589330 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b2ce4-b363-4798-a381-91e1d99f6274 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:05.622724 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a8cbe-5be9-4726-bd84-b731bbc61a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:05.623513 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a8cbe-5be9-4726-bd84-b731bbc61a76 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:05.623848 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a8cbe-5be9-4726-bd84-b731bbc61a76 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:05.624118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a8cbe-5be9-4726-bd84-b731bbc61a76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:05.630612 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a8cbe-5be9-4726-bd84-b731bbc61a76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:05.632075 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a8cbe-5be9-4726-bd84-b731bbc61a76 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:05.645317 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-ef6a8cbe-5be9-4726-bd84-b731bbc61a76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:54:05.645317 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:54:05.645317 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:54:05.645317 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:54:05.645317 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:54:05.645317 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:54:05.645317 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:54:05.645317 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:54:05.645317 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:54:05.645317 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:54:05.645317 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:54:05.645317 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:54:05.645317 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:54:05.645317 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:54:05.645317 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:54:05.646178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:54:05.646178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:54:05.646178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:54:05.646178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:54:05.646178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:54:05.646178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:54:05.646178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:54:05.646178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:54:05.646178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:54:05.646178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:54:05.646178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:54:05.646178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:54:05.646178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:54:05.646178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:54:05.646178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:54:05.646178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:54:05.646178 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:54:05.647066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:54:05.647066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:54:05.647066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:54:05.647066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:54:05.647066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:54:05.647066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:54:05.647066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:54:05.647066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:54:05.647066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 391/799] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:54:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:54:05.652599 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6acbd-5186-4446-840e-e5271d57e8f0 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:05.751591 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6acbd-5186-4446-840e-e5271d57e8f0 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:05.783464 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b32d1-2a46-4924-bf8b-34840186a1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:05.784144 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b32d1-2a46-4924-bf8b-34840186a1b3 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:05.784427 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b32d1-2a46-4924-bf8b-34840186a1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:05.784703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b32d1-2a46-4924-bf8b-34840186a1b3 None admin] PATH_INFO: `/v3/projects` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:05.785445 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b32d1-2a46-4924-bf8b-34840186a1b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:54:05.785750 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b32d1-2a46-4924-bf8b-34840186a1b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:05.787369 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b32d1-2a46-4924-bf8b-34840186a1b3 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:05.806547 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 409/800] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 12 16:54:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:54:07.618959 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b55b69-84d2-4c5e-9e73-92cb10314563 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:07.619486 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b55b69-84d2-4c5e-9e73-92cb10314563 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:07.619486 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b55b69-84d2-4c5e-9e73-92cb10314563 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:07.620883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 392/801] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:54:07.626235 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8757ab-32bc-4c9d-a167-05ba7f19b27d None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:07.626697 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8757ab-32bc-4c9d-a167-05ba7f19b27d None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:07.626806 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8757ab-32bc-4c9d-a167-05ba7f19b27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:07.643429 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-cb8757ab-32bc-4c9d-a167-05ba7f19b27d None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:54:07.644967 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-cb8757ab-32bc-4c9d-a167-05ba7f19b27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:54:07.707919 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 410/802] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:54:07 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:54:07.735420 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b55b69-84d2-4c5e-9e73-92cb10314563 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:07.832422 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b55b69-84d2-4c5e-9e73-92cb10314563 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:07.864516 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d8203-8bd3-4344-bf9d-2e549a1b5314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:07.865167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d8203-8bd3-4344-bf9d-2e549a1b5314 None admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:07.865440 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d8203-8bd3-4344-bf9d-2e549a1b5314 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:07.865708 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d8203-8bd3-4344-bf9d-2e549a1b5314 None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:07.866426 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d8203-8bd3-4344-bf9d-2e549a1b5314 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:07.867809 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d8203-8bd3-4344-bf9d-2e549a1b5314 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:07.880577 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 393/803] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 12 16:54:07 2022] POST /identity/v3/services => generated 242 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 16:54:08.118462 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09abee-d169-451e-81b4-180dae609813 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:08.118861 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09abee-d169-451e-81b4-180dae609813 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:08.119144 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09abee-d169-451e-81b4-180dae609813 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:08.120560 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 411/804] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:54:08.126469 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af18b4-357b-4bac-90ae-4b8908361d46 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:08.126831 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af18b4-357b-4bac-90ae-4b8908361d46 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:08.127116 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af18b4-357b-4bac-90ae-4b8908361d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:08.143335 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-b5af18b4-357b-4bac-90ae-4b8908361d46 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:54:08.144467 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-b5af18b4-357b-4bac-90ae-4b8908361d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:54:08.211773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 394/805] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:54:08 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 16:54:08.237669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09abee-d169-451e-81b4-180dae609813 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:08.333071 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09abee-d169-451e-81b4-180dae609813 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:08.371495 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45946fff-dc01-4e8e-9526-265f92e2481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:08.372195 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45946fff-dc01-4e8e-9526-265f92e2481b None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:08.372476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45946fff-dc01-4e8e-9526-265f92e2481b None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:08.372752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45946fff-dc01-4e8e-9526-265f92e2481b None admin] PATH_INFO: `/v3/users` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:08.373647 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45946fff-dc01-4e8e-9526-265f92e2481b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:08.374917 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45946fff-dc01-4e8e-9526-265f92e2481b None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:08.387778 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.sql.core [None req-45946fff-dc01-4e8e-9526-265f92e2481b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 16:54:08.387778 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 16:54:08.387778 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [parameters: {'user_id': '1bb67bea1e794db5af00530e2a4e8b43', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 16:54:08.387778 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86673) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 16:54:08.395018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-45946fff-dc01-4e8e-9526-265f92e2481b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 16:54:08.395018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:54:08.395018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 16:54:08.395018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 16:54:08.395018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 16:54:08.395018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 16:54:08.395018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 16:54:08.395018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application result = self._query(query) May 12 16:54:08.395018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 16:54:08.395018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application conn.query(q) May 12 16:54:08.395018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 16:54:08.395018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 16:54:08.395018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 16:54:08.395018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application result.read() May 12 16:54:08.395018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 16:54:08.396078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 16:54:08.396078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 16:54:08.396078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 16:54:08.396078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 16:54:08.396078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 16:54:08.396078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 16:54:08.396078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 16:54:08.396078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 16:54:08.396078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:08.396078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 16:54:08.396078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:08.396078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:54:08.396078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 16:54:08.396078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 16:54:08.396078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 12 16:54:08.396078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 12 16:54:08.396078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 16:54:08.396078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application next(self.gen) May 12 16:54:08.397058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 16:54:08.397058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application yield resource May 12 16:54:08.397058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 16:54:08.397058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application next(self.gen) May 12 16:54:08.397058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 16:54:08.397058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self.session.rollback() May 12 16:54:08.397058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 16:54:08.397058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self.force_reraise() May 12 16:54:08.397058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 16:54:08.397058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise self.value May 12 16:54:08.397058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 16:54:08.397058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 16:54:08.397058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 16:54:08.397058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application session.commit() May 12 16:54:08.397058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 16:54:08.397058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 16:54:08.397058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 16:54:08.397927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._prepare_impl() May 12 16:54:08.397927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 16:54:08.397927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self.session.flush() May 12 16:54:08.397927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 16:54:08.397927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._flush(objects) May 12 16:54:08.397927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 16:54:08.397927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 16:54:08.397927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 16:54:08.397927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application compat.raise_( May 12 16:54:08.397927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 16:54:08.397927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception May 12 16:54:08.397927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 16:54:08.397927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application flush_context.execute() May 12 16:54:08.397927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 16:54:08.397927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rec.execute(self) May 12 16:54:08.397927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 16:54:08.397927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 16:54:08.399666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 16:54:08.399666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 16:54:08.399666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 12 16:54:08.399666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application result = connection._execute_20( May 12 16:54:08.399666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 16:54:08.399666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 16:54:08.399666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 16:54:08.399666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 16:54:08.399666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 16:54:08.399666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 16:54:08.399666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 16:54:08.399666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 16:54:08.399666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 16:54:08.399666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 16:54:08.399666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 16:54:08.399666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception May 12 16:54:08.400498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 16:54:08.400498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 16:54:08.400498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 16:54:08.400498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 16:54:08.400498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 16:54:08.400498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application result = self._query(query) May 12 16:54:08.400498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 16:54:08.400498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application conn.query(q) May 12 16:54:08.400498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 16:54:08.400498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 16:54:08.400498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 16:54:08.400498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application result.read() May 12 16:54:08.400498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 16:54:08.400498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 16:54:08.400498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 16:54:08.400498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 16:54:08.402068 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 16:54:08.402068 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 16:54:08.402068 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 16:54:08.402068 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 16:54:08.402068 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 16:54:08.402068 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 16:54:08.402068 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [parameters: {'user_id': '1bb67bea1e794db5af00530e2a4e8b43', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 16:54:08.402068 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 16:54:08.402068 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:08.402068 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:54:08.402068 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:08.402068 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:54:08.402068 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:54:08.402068 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:54:08.402068 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:54:08.403562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:54:08.403562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:54:08.403562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:54:08.403562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:54:08.403562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:54:08.403562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:54:08.403562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:54:08.403562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 12 16:54:08.403562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 12 16:54:08.403562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:54:08.403562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:54:08.403562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:54:08.403562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:54:08.403562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:54:08.403562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:54:08.403562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 12 16:54:08.403562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 12 16:54:08.404664 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 12 16:54:08.404664 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 12 16:54:08.404664 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 16:54:08.404664 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 16:54:08.404664 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 16:54:08.404664 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:08.404664 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 412/806] 10.222.0.64 () {60 vars in 1131 bytes} [Thu May 12 16:54:08 2022] POST /identity/v3/users => generated 160 bytes in 159 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 12 16:54:08.405305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af18b4-357b-4bac-90ae-4b8908361d46 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:08.496855 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af18b4-357b-4bac-90ae-4b8908361d46 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:08.528994 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c42bb-0c94-4bcb-a334-30f3c60a720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:08.529766 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c42bb-0c94-4bcb-a334-30f3c60a720a None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:08.530041 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c42bb-0c94-4bcb-a334-30f3c60a720a None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:08.530305 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c42bb-0c94-4bcb-a334-30f3c60a720a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:08.536948 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c42bb-0c94-4bcb-a334-30f3c60a720a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:08.538368 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c42bb-0c94-4bcb-a334-30f3c60a720a None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:08.553593 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-c14c42bb-0c94-4bcb-a334-30f3c60a720a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 16:54:08.553593 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:54:08.553593 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:54:08.553593 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:54:08.553593 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:54:08.553593 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:54:08.553593 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:54:08.553593 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:54:08.553593 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:54:08.553593 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:54:08.553593 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:54:08.553593 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:54:08.553593 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:54:08.553593 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:54:08.553593 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:54:08.553593 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:54:08.554610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:54:08.554610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:54:08.554610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:54:08.554610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:54:08.554610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:54:08.554610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:54:08.554610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:54:08.554610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:54:08.554610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:54:08.554610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:54:08.554610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:54:08.554610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:54:08.554610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:54:08.554610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:54:08.554610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:54:08.554610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:54:08.554610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:54:08.554610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:54:08.555546 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:54:08.555546 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:54:08.555546 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:54:08.555546 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:54:08.555546 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:54:08.555546 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:54:08.555546 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:54:08.555546 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:54:08.555546 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 16:54:08.555546 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:54:08.555546 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 395/807] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:54:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:54:08.561103 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45946fff-dc01-4e8e-9526-265f92e2481b None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:08.657024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45946fff-dc01-4e8e-9526-265f92e2481b None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:08.691038 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d9df2-e4d7-4449-8021-bb65d6ca2936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:08.691735 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d9df2-e4d7-4449-8021-bb65d6ca2936 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:08.692023 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d9df2-e4d7-4449-8021-bb65d6ca2936 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:08.692300 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d9df2-e4d7-4449-8021-bb65d6ca2936 None admin] PATH_INFO: `/v3/users` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:08.693103 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d9df2-e4d7-4449-8021-bb65d6ca2936 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:54:08.693409 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d9df2-e4d7-4449-8021-bb65d6ca2936 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:08.695054 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d9df2-e4d7-4449-8021-bb65d6ca2936 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:08.733888 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 413/808] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 12 16:54:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:54:10.162584 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22fe20-9c62-45ad-80ff-5c9340c22e04 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:10.163077 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22fe20-9c62-45ad-80ff-5c9340c22e04 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:10.163077 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22fe20-9c62-45ad-80ff-5c9340c22e04 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:10.164487 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 396/809] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:54:10.169726 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559aa429-550f-4278-8e96-4de350b9071d None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:10.170138 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559aa429-550f-4278-8e96-4de350b9071d None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:10.170283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559aa429-550f-4278-8e96-4de350b9071d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:10.186659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-559aa429-550f-4278-8e96-4de350b9071d None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:54:10.188201 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-559aa429-550f-4278-8e96-4de350b9071d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:54:10.250741 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 414/810] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:54:10 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:54:10.274205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22fe20-9c62-45ad-80ff-5c9340c22e04 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:10.370851 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22fe20-9c62-45ad-80ff-5c9340c22e04 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:10.403526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c5202-6e46-4b61-a7b6-f9e6b2b70121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:10.404315 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c5202-6e46-4b61-a7b6-f9e6b2b70121 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:10.404591 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c5202-6e46-4b61-a7b6-f9e6b2b70121 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:10.404859 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c5202-6e46-4b61-a7b6-f9e6b2b70121 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:10.405492 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c5202-6e46-4b61-a7b6-f9e6b2b70121 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:10.406833 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c5202-6e46-4b61-a7b6-f9e6b2b70121 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:10.418014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-507c5202-6e46-4b61-a7b6-f9e6b2b70121 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 16:54:10.418014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:54:10.418014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:54:10.418014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:54:10.418014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:54:10.418014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:54:10.418014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:54:10.418014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:54:10.418014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 16:54:10.418014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:54:10.418014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:54:10.418014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:54:10.418014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:54:10.418014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:54:10.418014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:54:10.418014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:54:10.418014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:54:10.419127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:54:10.419127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:54:10.419127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:54:10.419127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:54:10.419127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:54:10.419127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:54:10.419127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:54:10.419127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:54:10.419127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:54:10.419127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:54:10.419127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:54:10.419127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:54:10.419127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:54:10.419127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:54:10.419127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:54:10.419127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:54:10.420014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:54:10.420014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:54:10.420014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:54:10.420014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:54:10.420014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:54:10.420014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:54:10.420014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:54:10.420014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:54:10.420014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:54:10.420014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:54:10.420014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:54:10.420014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:54:10.420014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 16:54:10.420014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:54:10.420014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 397/811] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:54:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:54:10.425210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559aa429-550f-4278-8e96-4de350b9071d None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:10.517537 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559aa429-550f-4278-8e96-4de350b9071d None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:10.548574 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6a0d0-6fbd-4919-b0ae-9d77efe4252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:10.549227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6a0d0-6fbd-4919-b0ae-9d77efe4252d None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:10.549509 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6a0d0-6fbd-4919-b0ae-9d77efe4252d None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:10.549783 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6a0d0-6fbd-4919-b0ae-9d77efe4252d None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:10.550488 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6a0d0-6fbd-4919-b0ae-9d77efe4252d None admin] RBAC: Adding query filter params (name=compute) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:54:10.550794 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6a0d0-6fbd-4919-b0ae-9d77efe4252d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:10.552199 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6a0d0-6fbd-4919-b0ae-9d77efe4252d None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:10.556816 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 415/812] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 12 16:54:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:54:10.562910 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c5202-6e46-4b61-a7b6-f9e6b2b70121 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:10.654718 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c5202-6e46-4b61-a7b6-f9e6b2b70121 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:10.685665 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51e51b-356d-4a96-9282-da07edb0b73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:10.686245 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51e51b-356d-4a96-9282-da07edb0b73d None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:10.686520 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51e51b-356d-4a96-9282-da07edb0b73d None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:10.686789 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51e51b-356d-4a96-9282-da07edb0b73d None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:10.687480 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51e51b-356d-4a96-9282-da07edb0b73d None admin] RBAC: Adding query filter params (type=compute) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:54:10.687812 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51e51b-356d-4a96-9282-da07edb0b73d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:10.689151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51e51b-356d-4a96-9282-da07edb0b73d None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:10.693603 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 398/813] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 12 16:54:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:54:10.699980 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6a0d0-6fbd-4919-b0ae-9d77efe4252d None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:10.793654 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6a0d0-6fbd-4919-b0ae-9d77efe4252d None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:10.825193 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a2eb4-cfc8-42ef-96e6-5ffd91a9af57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:10.825868 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a2eb4-cfc8-42ef-96e6-5ffd91a9af57 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:10.826153 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a2eb4-cfc8-42ef-96e6-5ffd91a9af57 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:10.826430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a2eb4-cfc8-42ef-96e6-5ffd91a9af57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:10.827245 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a2eb4-cfc8-42ef-96e6-5ffd91a9af57 None admin] RBAC: Adding query filter params (interface=public, service_id=462480cf614c473aa98a40d758040e85, region_id=RegionOne) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:54:10.827557 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a2eb4-cfc8-42ef-96e6-5ffd91a9af57 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:10.828961 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a2eb4-cfc8-42ef-96e6-5ffd91a9af57 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:10.833770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 416/814] 10.222.0.64 () {56 vars in 1251 bytes} [Thu May 12 16:54:10 2022] GET /identity/v3/endpoints?service_id=462480cf614c473aa98a40d758040e85&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:54:10.839242 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51e51b-356d-4a96-9282-da07edb0b73d None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:10.932278 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51e51b-356d-4a96-9282-da07edb0b73d None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:10.963251 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47ea7a-c9d5-45fe-a21f-8c9bcbc27da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:10.963862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47ea7a-c9d5-45fe-a21f-8c9bcbc27da1 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:10.964139 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47ea7a-c9d5-45fe-a21f-8c9bcbc27da1 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:10.964408 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47ea7a-c9d5-45fe-a21f-8c9bcbc27da1 None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:10.965102 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47ea7a-c9d5-45fe-a21f-8c9bcbc27da1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:10.966450 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47ea7a-c9d5-45fe-a21f-8c9bcbc27da1 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:10.972314 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 399/815] 10.222.0.64 () {56 vars in 1087 bytes} [Thu May 12 16:54:10 2022] GET /identity/v3/services => generated 1728 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:54:13.197291 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778cb6b-2634-4068-93e6-e17e55f25a8b None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:13.197792 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778cb6b-2634-4068-93e6-e17e55f25a8b None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:13.197792 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778cb6b-2634-4068-93e6-e17e55f25a8b None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:13.199145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 417/816] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:54:13.204251 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51a116-0935-4cf0-a630-b938bd8c8a40 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:13.204618 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51a116-0935-4cf0-a630-b938bd8c8a40 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:13.204801 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51a116-0935-4cf0-a630-b938bd8c8a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:13.220769 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-ff51a116-0935-4cf0-a630-b938bd8c8a40 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:54:13.221922 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-ff51a116-0935-4cf0-a630-b938bd8c8a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:54:13.283135 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 400/817] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:54:13 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:54:13.306342 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778cb6b-2634-4068-93e6-e17e55f25a8b None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:13.401619 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8778cb6b-2634-4068-93e6-e17e55f25a8b None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:13.434526 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214e0e8-ca47-4b1f-96d0-0751d3f1f1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:13.435302 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214e0e8-ca47-4b1f-96d0-0751d3f1f1bf None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:13.435583 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214e0e8-ca47-4b1f-96d0-0751d3f1f1bf None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:13.435883 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214e0e8-ca47-4b1f-96d0-0751d3f1f1bf None admin] PATH_INFO: `/v3/services/compute` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:13.436526 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214e0e8-ca47-4b1f-96d0-0751d3f1f1bf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:13.437883 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214e0e8-ca47-4b1f-96d0-0751d3f1f1bf None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:13.449227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-7214e0e8-ca47-4b1f-96d0-0751d3f1f1bf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 16:54:13.449227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:54:13.449227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:54:13.449227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:54:13.449227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:54:13.449227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:54:13.449227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:54:13.449227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:54:13.449227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 16:54:13.449227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:13.449227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:54:13.449227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:13.449227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:54:13.449227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:54:13.449227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:54:13.449227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:54:13.449227 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:54:13.450146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:54:13.450146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:54:13.450146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:54:13.450146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:54:13.450146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:54:13.450146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:54:13.450146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:54:13.450146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:54:13.450146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:54:13.450146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:54:13.450146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:54:13.450146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:54:13.450146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:54:13.450146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:54:13.450146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:54:13.450146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:54:13.451050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:54:13.451050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:54:13.451050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:54:13.451050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:54:13.451050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:54:13.451050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:54:13.451050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:54:13.451050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:54:13.451050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:54:13.451050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:54:13.451050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:54:13.451050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:54:13.451050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 16:54:13.451050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:54:13.451050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 418/818] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:54:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:54:13.456279 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51a116-0935-4cf0-a630-b938bd8c8a40 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:13.552357 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51a116-0935-4cf0-a630-b938bd8c8a40 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:13.583027 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a495410-84e9-4234-a304-014d56604856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:13.583695 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a495410-84e9-4234-a304-014d56604856 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:13.583973 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a495410-84e9-4234-a304-014d56604856 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:13.584241 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a495410-84e9-4234-a304-014d56604856 None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:13.584930 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a495410-84e9-4234-a304-014d56604856 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:54:13.585227 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a495410-84e9-4234-a304-014d56604856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:13.586576 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a495410-84e9-4234-a304-014d56604856 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:13.591598 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 401/819] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 12 16:54:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:54:13.597235 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214e0e8-ca47-4b1f-96d0-0751d3f1f1bf None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:13.690413 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214e0e8-ca47-4b1f-96d0-0751d3f1f1bf None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:13.721620 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1ffc2-b0fe-4c3b-a2fb-8fb25ba68118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:13.722289 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1ffc2-b0fe-4c3b-a2fb-8fb25ba68118 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:13.722570 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1ffc2-b0fe-4c3b-a2fb-8fb25ba68118 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:13.722843 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1ffc2-b0fe-4c3b-a2fb-8fb25ba68118 None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:13.723539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1ffc2-b0fe-4c3b-a2fb-8fb25ba68118 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:54:13.723882 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1ffc2-b0fe-4c3b-a2fb-8fb25ba68118 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:13.725503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1ffc2-b0fe-4c3b-a2fb-8fb25ba68118 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:13.730070 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 419/820] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 12 16:54:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:54:13.736123 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a495410-84e9-4234-a304-014d56604856 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:54:13.829300 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a495410-84e9-4234-a304-014d56604856 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:54:13.860939 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97746a-c43a-4f44-bd8e-0fb21f29d7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:54:13.861575 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97746a-c43a-4f44-bd8e-0fb21f29d7d4 None admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:54:13.861851 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97746a-c43a-4f44-bd8e-0fb21f29d7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:54:13.862118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97746a-c43a-4f44-bd8e-0fb21f29d7d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:54:13.862850 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97746a-c43a-4f44-bd8e-0fb21f29d7d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:54:13.864233 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97746a-c43a-4f44-bd8e-0fb21f29d7d4 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:54:13.880837 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 402/821] 10.222.0.64 () {60 vars in 1144 bytes} [Thu May 12 16:54:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 16:55:15.306838 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38ba23-2d69-41d4-8175-0b78fbc5905b None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:15.306838 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38ba23-2d69-41d4-8175-0b78fbc5905b None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:15.306838 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38ba23-2d69-41d4-8175-0b78fbc5905b None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:15.306838 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 420/822] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:55:15.313142 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097888c-82d6-4892-95f1-2f64e9ad23ea None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:15.313592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097888c-82d6-4892-95f1-2f64e9ad23ea None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:15.313694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097888c-82d6-4892-95f1-2f64e9ad23ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:15.330835 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-5097888c-82d6-4892-95f1-2f64e9ad23ea None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:55:15.332313 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-5097888c-82d6-4892-95f1-2f64e9ad23ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:55:15.427661 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 403/823] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:55:15 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 16:55:15.444374 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38ba23-2d69-41d4-8175-0b78fbc5905b None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:15.559723 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38ba23-2d69-41d4-8175-0b78fbc5905b None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:15.598501 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8b64f-72ff-42c3-af3a-6d7ac7bef6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:15.599690 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8b64f-72ff-42c3-af3a-6d7ac7bef6d2 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:15.600069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8b64f-72ff-42c3-af3a-6d7ac7bef6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:15.600594 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8b64f-72ff-42c3-af3a-6d7ac7bef6d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:15.615192 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8b64f-72ff-42c3-af3a-6d7ac7bef6d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:15.616884 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8b64f-72ff-42c3-af3a-6d7ac7bef6d2 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:15.637860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-3ca8b64f-72ff-42c3-af3a-6d7ac7bef6d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:15.637860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:15.637860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:15.637860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:15.637860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:15.637860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:15.637860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:15.637860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:15.637860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:15.637860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:15.637860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:15.637860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:15.637860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:55:15.637860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:55:15.637860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:55:15.638911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:55:15.638911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:15.638911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:15.638911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:15.638911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:15.638911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:15.638911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:15.638911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:15.638911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:55:15.638911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:15.638911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:15.638911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:15.638911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:15.638911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:15.638911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:15.638911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:15.638911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:15.640123 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:55:15.640123 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:55:15.640123 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:15.640123 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:55:15.640123 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 421/824] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:55:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:15.645213 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097888c-82d6-4892-95f1-2f64e9ad23ea None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:15.756428 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097888c-82d6-4892-95f1-2f64e9ad23ea None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:15.794741 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44afe6a-a593-4e8c-8b88-1701d460d3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:15.795438 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44afe6a-a593-4e8c-8b88-1701d460d3c0 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:15.795744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44afe6a-a593-4e8c-8b88-1701d460d3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:15.796018 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44afe6a-a593-4e8c-8b88-1701d460d3c0 None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:15.796804 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44afe6a-a593-4e8c-8b88-1701d460d3c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:15.797176 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44afe6a-a593-4e8c-8b88-1701d460d3c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:15.798483 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44afe6a-a593-4e8c-8b88-1701d460d3c0 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:15.812589 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 404/825] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:55:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:15.818423 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8b64f-72ff-42c3-af3a-6d7ac7bef6d2 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:15.933190 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8b64f-72ff-42c3-af3a-6d7ac7bef6d2 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:15.969816 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e37f6-12d7-4cfc-9c92-53976e8f58b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:15.970486 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e37f6-12d7-4cfc-9c92-53976e8f58b6 None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:15.970788 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e37f6-12d7-4cfc-9c92-53976e8f58b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:15.971045 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e37f6-12d7-4cfc-9c92-53976e8f58b6 None admin] PATH_INFO: `/v3/users` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:15.971792 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e37f6-12d7-4cfc-9c92-53976e8f58b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:15.973217 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e37f6-12d7-4cfc-9c92-53976e8f58b6 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:15.998775 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 422/826] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 12 16:55:15 2022] POST /identity/v3/users => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:55:18.310985 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b8f0a-f603-4a5c-8e19-2e4f4bda8ef6 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:18.311490 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b8f0a-f603-4a5c-8e19-2e4f4bda8ef6 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:18.311490 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b8f0a-f603-4a5c-8e19-2e4f4bda8ef6 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:18.313016 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 405/827] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:55:18.318411 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9617c-16bd-4d1e-a348-286d4f70bfc4 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:18.318819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9617c-16bd-4d1e-a348-286d4f70bfc4 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:18.318966 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9617c-16bd-4d1e-a348-286d4f70bfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:18.337693 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-d5c9617c-16bd-4d1e-a348-286d4f70bfc4 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:55:18.339170 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-d5c9617c-16bd-4d1e-a348-286d4f70bfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:55:18.415727 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 423/828] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:55:18 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:55:18.438626 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b8f0a-f603-4a5c-8e19-2e4f4bda8ef6 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:18.556093 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b8f0a-f603-4a5c-8e19-2e4f4bda8ef6 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:18.592165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fbb6d-03ae-418b-9181-903cf4bd1caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:18.592891 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fbb6d-03ae-418b-9181-903cf4bd1caf None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:18.593177 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fbb6d-03ae-418b-9181-903cf4bd1caf None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:18.593446 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fbb6d-03ae-418b-9181-903cf4bd1caf None admin] PATH_INFO: `/v3/roles/service` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:18.605157 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fbb6d-03ae-418b-9181-903cf4bd1caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:55:18.613066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-959fbb6d-03ae-418b-9181-903cf4bd1caf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:55:18.613066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:18.613066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:18.613066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:18.613066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:18.613066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:18.613066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:18.613066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:18.613066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:18.613066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:18.613066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:18.613066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:18.613066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:55:18.613066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:55:18.613066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:55:18.613066 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:55:18.614967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:55:18.614967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:55:18.614967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:55:18.614967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:55:18.614967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:18.614967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:18.614967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:18.614967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:18.614967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:18.614967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:18.614967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:18.614967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:55:18.614967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:18.614967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:18.614967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:18.614967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:18.616290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:18.616290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:18.616290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:18.616290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:18.616290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:55:18.616290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:55:18.616290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:55:18.616290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:55:18.616290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:55:18.616290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:55:18.616290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:55:18.616290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:18.616290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 406/829] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 12 16:55:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:18.620952 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9617c-16bd-4d1e-a348-286d4f70bfc4 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:18.723174 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9617c-16bd-4d1e-a348-286d4f70bfc4 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:18.759698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f73fb4-8866-4fa6-acd4-b040b470a5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:18.760374 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f73fb4-8866-4fa6-acd4-b040b470a5c3 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:18.760656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f73fb4-8866-4fa6-acd4-b040b470a5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:18.760977 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f73fb4-8866-4fa6-acd4-b040b470a5c3 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:18.761689 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f73fb4-8866-4fa6-acd4-b040b470a5c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:18.762002 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f73fb4-8866-4fa6-acd4-b040b470a5c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:18.763391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f73fb4-8866-4fa6-acd4-b040b470a5c3 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:18.771820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 424/830] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 12 16:55:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:18.778048 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fbb6d-03ae-418b-9181-903cf4bd1caf None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:18.882863 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fbb6d-03ae-418b-9181-903cf4bd1caf None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:18.918414 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedc058-68e0-46a6-aa50-96a31de1bd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:18.919299 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedc058-68e0-46a6-aa50-96a31de1bd2f None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:18.919555 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedc058-68e0-46a6-aa50-96a31de1bd2f None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:18.919907 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedc058-68e0-46a6-aa50-96a31de1bd2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:18.930842 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedc058-68e0-46a6-aa50-96a31de1bd2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:18.932566 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedc058-68e0-46a6-aa50-96a31de1bd2f None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:18.951862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-2cedc058-68e0-46a6-aa50-96a31de1bd2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:18.951862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:18.951862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:18.951862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:18.951862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:18.951862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:18.951862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:18.951862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:18.951862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:18.951862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:18.951862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:18.951862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:18.951862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:55:18.951862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:55:18.951862 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:55:18.953226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:55:18.953226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:18.953226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:18.953226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:18.953226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:18.953226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:18.953226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:18.953226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:18.953226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:55:18.953226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:18.953226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:18.953226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:18.953226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:18.953226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:18.953226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:18.953226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:18.953226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:18.954117 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:55:18.954117 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:55:18.954117 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:18.954117 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:18.954117 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 407/831] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:55:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:18.959283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f73fb4-8866-4fa6-acd4-b040b470a5c3 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:19.067449 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f73fb4-8866-4fa6-acd4-b040b470a5c3 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:19.109201 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68eb27c-9310-4696-87bd-f93f50765c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:19.109958 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68eb27c-9310-4696-87bd-f93f50765c97 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:19.110289 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68eb27c-9310-4696-87bd-f93f50765c97 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:19.110572 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68eb27c-9310-4696-87bd-f93f50765c97 None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:19.111297 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68eb27c-9310-4696-87bd-f93f50765c97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:19.111716 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68eb27c-9310-4696-87bd-f93f50765c97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:19.113141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68eb27c-9310-4696-87bd-f93f50765c97 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:19.126147 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 425/832] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:19.132359 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedc058-68e0-46a6-aa50-96a31de1bd2f None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:19.241976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedc058-68e0-46a6-aa50-96a31de1bd2f None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:19.276659 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8911a6-e202-424b-9585-30f37a2dd1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:19.277550 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8911a6-e202-424b-9585-30f37a2dd1a8 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:19.277860 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8911a6-e202-424b-9585-30f37a2dd1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:19.279005 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8911a6-e202-424b-9585-30f37a2dd1a8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:19.286987 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8911a6-e202-424b-9585-30f37a2dd1a8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:19.288484 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8911a6-e202-424b-9585-30f37a2dd1a8 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:19.303378 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-8b8911a6-e202-424b-9585-30f37a2dd1a8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 16:55:19.303378 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:19.303378 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:19.303378 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:19.303378 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:19.303378 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:19.303378 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:19.303378 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:19.303378 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:19.303378 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:19.303378 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:19.303378 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:19.303378 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:55:19.303378 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:55:19.303378 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:55:19.303378 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:55:19.304683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:19.304683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:19.304683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:55:19.304683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:55:19.304683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:55:19.304683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:55:19.304683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:19.304683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:19.304683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:19.304683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:19.304683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:19.304683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:55:19.304683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:19.304683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:19.304683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:19.304683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:19.304683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:19.304683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:19.306095 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:19.306095 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:19.306095 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:55:19.306095 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:55:19.306095 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:55:19.306095 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:55:19.306095 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:55:19.306095 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:55:19.306095 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 16:55:19.306095 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:19.306095 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 408/833] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:55:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:19.311089 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68eb27c-9310-4696-87bd-f93f50765c97 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:19.415032 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68eb27c-9310-4696-87bd-f93f50765c97 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:19.451255 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060ae3f-63a7-467f-a16e-b8db290cfd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:19.452081 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060ae3f-63a7-467f-a16e-b8db290cfd31 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:19.452356 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060ae3f-63a7-467f-a16e-b8db290cfd31 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:19.452629 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060ae3f-63a7-467f-a16e-b8db290cfd31 None admin] PATH_INFO: `/v3/users` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:19.453457 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060ae3f-63a7-467f-a16e-b8db290cfd31 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:19.453766 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060ae3f-63a7-467f-a16e-b8db290cfd31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:19.455205 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060ae3f-63a7-467f-a16e-b8db290cfd31 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:19.476387 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 426/834] 10.222.0.64 () {56 vars in 1143 bytes} [Thu May 12 16:55:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:19.481859 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8911a6-e202-424b-9585-30f37a2dd1a8 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:19.598404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8911a6-e202-424b-9585-30f37a2dd1a8 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:19.634676 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2c228-ea12-4e8c-bc68-c9786c2537d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:19.635317 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2c228-ea12-4e8c-bc68-c9786c2537d4 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:19.635605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2c228-ea12-4e8c-bc68-c9786c2537d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:19.635908 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2c228-ea12-4e8c-bc68-c9786c2537d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:19.704817 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2c228-ea12-4e8c-bc68-c9786c2537d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:19.706410 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2c228-ea12-4e8c-bc68-c9786c2537d4 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:19.808629 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 409/835] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:55:19 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 16:55:19.814466 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060ae3f-63a7-467f-a16e-b8db290cfd31 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:19.920732 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060ae3f-63a7-467f-a16e-b8db290cfd31 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:19.955354 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383990b-71aa-4521-ae8c-aa84f524fc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:19.956190 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383990b-71aa-4521-ae8c-aa84f524fc61 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:19.956466 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383990b-71aa-4521-ae8c-aa84f524fc61 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:19.956745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383990b-71aa-4521-ae8c-aa84f524fc61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:19.966331 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383990b-71aa-4521-ae8c-aa84f524fc61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:19.967852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383990b-71aa-4521-ae8c-aa84f524fc61 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:19.987683 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-6383990b-71aa-4521-ae8c-aa84f524fc61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:19.987683 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:19.987683 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:19.987683 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:19.987683 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:19.987683 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:19.987683 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:19.987683 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:19.987683 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:19.987683 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:19.987683 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:19.987683 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:19.987683 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:55:19.987683 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:55:19.987683 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:55:19.988934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:55:19.988934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:19.988934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:19.988934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:19.988934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:19.988934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:19.988934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:19.988934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:19.988934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:55:19.988934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:19.988934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:19.988934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:19.988934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:19.988934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:19.988934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:19.988934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:19.988934 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:19.990081 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:55:19.990081 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:55:19.990081 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:19.990081 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:55:19.994516 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 427/836] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:55:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:19.995586 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2c228-ea12-4e8c-bc68-c9786c2537d4 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:20.095752 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2c228-ea12-4e8c-bc68-c9786c2537d4 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:20.136272 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f54e9-13a1-441c-a546-672704e3cef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:20.137096 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f54e9-13a1-441c-a546-672704e3cef2 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:20.137423 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f54e9-13a1-441c-a546-672704e3cef2 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:20.137952 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f54e9-13a1-441c-a546-672704e3cef2 None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:20.138749 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f54e9-13a1-441c-a546-672704e3cef2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:20.139032 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f54e9-13a1-441c-a546-672704e3cef2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:20.140486 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f54e9-13a1-441c-a546-672704e3cef2 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:20.153239 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 410/837] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:20.159119 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383990b-71aa-4521-ae8c-aa84f524fc61 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:20.261361 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383990b-71aa-4521-ae8c-aa84f524fc61 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:20.296410 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb57b4a-8543-44c5-9bd3-1f48a5c17274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:20.297203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb57b4a-8543-44c5-9bd3-1f48a5c17274 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:20.297530 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb57b4a-8543-44c5-9bd3-1f48a5c17274 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:20.297858 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb57b4a-8543-44c5-9bd3-1f48a5c17274 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:20.305196 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb57b4a-8543-44c5-9bd3-1f48a5c17274 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:20.306644 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb57b4a-8543-44c5-9bd3-1f48a5c17274 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:20.323067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-8fb57b4a-8543-44c5-9bd3-1f48a5c17274 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:55:20.323067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:20.323067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:20.323067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:20.323067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:20.323067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:20.323067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:20.323067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:20.323067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:20.323067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:20.323067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:20.323067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:20.323067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:55:20.323067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:55:20.323067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:55:20.324203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:55:20.324203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:20.324203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:20.324203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:20.324203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:20.324203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:20.324203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:20.324203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:20.324203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:55:20.324203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:20.324203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:20.324203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:20.324203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:20.324203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:20.324203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:20.324203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:20.324203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:20.325229 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:55:20.325229 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:55:20.325229 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:55:20.325229 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:55:20.325229 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:55:20.325229 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:55:20.325229 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:55:20.325229 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:55:20.325229 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 428/838] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:55:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:20.331219 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f54e9-13a1-441c-a546-672704e3cef2 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:20.432865 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f54e9-13a1-441c-a546-672704e3cef2 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:20.481965 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa469b5a-399d-4977-abee-7848f01973ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:20.482709 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa469b5a-399d-4977-abee-7848f01973ca None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:20.482916 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa469b5a-399d-4977-abee-7848f01973ca None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:20.483171 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa469b5a-399d-4977-abee-7848f01973ca None admin] PATH_INFO: `/v3/projects` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:20.483993 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa469b5a-399d-4977-abee-7848f01973ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:20.484303 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa469b5a-399d-4977-abee-7848f01973ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:20.485738 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa469b5a-399d-4977-abee-7848f01973ca None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:20.500183 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 411/839] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:55:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:55:20.507358 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb57b4a-8543-44c5-9bd3-1f48a5c17274 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:20.617657 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb57b4a-8543-44c5-9bd3-1f48a5c17274 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:20.651069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4787b-27c0-47ae-8d20-564273993871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:20.651808 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4787b-27c0-47ae-8d20-564273993871 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:20.652120 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4787b-27c0-47ae-8d20-564273993871 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:20.652397 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4787b-27c0-47ae-8d20-564273993871 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:20.653238 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4787b-27c0-47ae-8d20-564273993871 None admin] RBAC: Adding query filter params (role.id=0f1a9958b7874b10b41712760f0b6ffa, scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff, user.id=8c64a6e5ef494d00817bb47cd6fd2bc4) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:20.653588 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4787b-27c0-47ae-8d20-564273993871 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:20.655097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4787b-27c0-47ae-8d20-564273993871 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:20.661211 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 429/840] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:55:20 2022] GET /identity/v3/role_assignments?user.id=8c64a6e5ef494d00817bb47cd6fd2bc4&scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff&role.id=0f1a9958b7874b10b41712760f0b6ffa => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:55:23.125505 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2873855-b8af-47b4-af84-65e8ae83197b None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:23.126051 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2873855-b8af-47b4-af84-65e8ae83197b None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:23.126051 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2873855-b8af-47b4-af84-65e8ae83197b None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:23.127387 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 412/841] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:55:23.132838 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93f95f-2337-47e2-8d2c-6a7acb5ddb2f None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:23.133240 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93f95f-2337-47e2-8d2c-6a7acb5ddb2f None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:23.133403 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93f95f-2337-47e2-8d2c-6a7acb5ddb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:23.150343 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-3d93f95f-2337-47e2-8d2c-6a7acb5ddb2f None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:55:23.151745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-3d93f95f-2337-47e2-8d2c-6a7acb5ddb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:55:23.219119 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 430/842] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:55:23 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:55:23.250079 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2873855-b8af-47b4-af84-65e8ae83197b None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:23.355321 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2873855-b8af-47b4-af84-65e8ae83197b None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:23.392891 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba2be7-07f6-4edc-80ab-dc0cb104cb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:23.393973 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba2be7-07f6-4edc-80ab-dc0cb104cb91 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:23.394257 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba2be7-07f6-4edc-80ab-dc0cb104cb91 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:23.394534 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba2be7-07f6-4edc-80ab-dc0cb104cb91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:23.407170 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba2be7-07f6-4edc-80ab-dc0cb104cb91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:55:23.415404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-8aba2be7-07f6-4edc-80ab-dc0cb104cb91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:55:23.415404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:23.415404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:23.415404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:23.415404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:23.415404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:23.415404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:23.415404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:23.415404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:23.415404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:23.415404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:23.415404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:23.415404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:55:23.415404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:55:23.415404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:55:23.415404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:55:23.416633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:55:23.416633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:55:23.416633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:55:23.416633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:55:23.416633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:23.416633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:23.416633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:23.416633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:23.416633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:23.416633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:23.416633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:23.416633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:55:23.416633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:23.416633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:23.416633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:23.416633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:23.417668 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:23.417668 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:23.417668 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:23.417668 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:23.417668 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:55:23.417668 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:55:23.417668 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:55:23.417668 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:55:23.417668 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:55:23.417668 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:55:23.417668 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:55:23.417668 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:23.417668 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 413/843] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 12 16:55:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:23.422609 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93f95f-2337-47e2-8d2c-6a7acb5ddb2f None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:23.531342 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93f95f-2337-47e2-8d2c-6a7acb5ddb2f None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:23.567077 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f47db1-e005-4f03-a8ff-c709ca624441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:23.568679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f47db1-e005-4f03-a8ff-c709ca624441 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:23.570189 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f47db1-e005-4f03-a8ff-c709ca624441 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:23.570633 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f47db1-e005-4f03-a8ff-c709ca624441 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:23.571264 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f47db1-e005-4f03-a8ff-c709ca624441 None admin] RBAC: Adding query filter params (name=service) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:23.572923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f47db1-e005-4f03-a8ff-c709ca624441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:23.573054 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f47db1-e005-4f03-a8ff-c709ca624441 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:23.581596 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 431/844] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 12 16:55:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:23.587938 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba2be7-07f6-4edc-80ab-dc0cb104cb91 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:23.690608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba2be7-07f6-4edc-80ab-dc0cb104cb91 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:23.725948 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111502be-974d-45d3-b7c7-9ce0e158ac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:23.727247 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111502be-974d-45d3-b7c7-9ce0e158ac68 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:23.727552 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111502be-974d-45d3-b7c7-9ce0e158ac68 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:23.727854 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111502be-974d-45d3-b7c7-9ce0e158ac68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:23.738606 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111502be-974d-45d3-b7c7-9ce0e158ac68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:23.740172 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111502be-974d-45d3-b7c7-9ce0e158ac68 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:23.756883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-111502be-974d-45d3-b7c7-9ce0e158ac68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:23.756883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:23.756883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:23.756883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:23.756883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:23.756883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:23.756883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:23.756883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:23.756883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:23.756883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:23.756883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:23.756883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:23.756883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:55:23.756883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:55:23.756883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:55:23.758694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:55:23.758694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:23.758694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:23.758694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:23.758694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:23.758694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:23.758694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:23.758694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:23.758694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:55:23.758694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:23.758694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:23.758694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:23.758694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:23.758694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:23.758694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:23.758694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:23.758694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:23.760214 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:55:23.760214 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:55:23.760214 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:23.760214 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:23.760214 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 414/845] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:55:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:23.764566 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f47db1-e005-4f03-a8ff-c709ca624441 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:23.864958 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f47db1-e005-4f03-a8ff-c709ca624441 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:23.902746 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667c093-bbb4-4134-988d-e50eff956f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:23.903428 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667c093-bbb4-4134-988d-e50eff956f88 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:23.903805 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667c093-bbb4-4134-988d-e50eff956f88 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:23.904141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667c093-bbb4-4134-988d-e50eff956f88 None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:23.904823 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667c093-bbb4-4134-988d-e50eff956f88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:23.908225 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667c093-bbb4-4134-988d-e50eff956f88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:23.908225 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667c093-bbb4-4134-988d-e50eff956f88 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:23.920366 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 432/846] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:23.926351 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111502be-974d-45d3-b7c7-9ce0e158ac68 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:24.037696 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111502be-974d-45d3-b7c7-9ce0e158ac68 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:24.072907 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecba5d4-20f8-4bb2-8c3c-e83c35e9866a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:24.073737 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecba5d4-20f8-4bb2-8c3c-e83c35e9866a None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:24.074035 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecba5d4-20f8-4bb2-8c3c-e83c35e9866a None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:24.074342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecba5d4-20f8-4bb2-8c3c-e83c35e9866a None admin] PATH_INFO: `/v3/users/placement` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:24.081827 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecba5d4-20f8-4bb2-8c3c-e83c35e9866a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:24.083336 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecba5d4-20f8-4bb2-8c3c-e83c35e9866a None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:24.098081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-3ecba5d4-20f8-4bb2-8c3c-e83c35e9866a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 16:55:24.098081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:24.098081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:24.098081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:24.098081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:24.098081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:24.098081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:24.098081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:24.098081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:24.098081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:24.098081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:24.098081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:24.098081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:55:24.098081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:55:24.098081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:55:24.098081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:55:24.099456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:24.099456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:24.099456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:55:24.099456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:55:24.099456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:55:24.099456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:55:24.099456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:24.099456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:24.099456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:24.099456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:24.099456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:24.099456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:55:24.099456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:24.099456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:24.099456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:24.099456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:24.099456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:24.099456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:24.100708 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:24.100708 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:24.100708 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:55:24.100708 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:55:24.100708 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:55:24.100708 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:55:24.100708 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:55:24.100708 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:55:24.100708 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 16:55:24.100708 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:24.100708 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 415/847] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:55:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:55:24.105492 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667c093-bbb4-4134-988d-e50eff956f88 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:24.204968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667c093-bbb4-4134-988d-e50eff956f88 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:24.240849 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f1822-8f55-4e4c-a3ca-1def694f2c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:24.241525 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f1822-8f55-4e4c-a3ca-1def694f2c01 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:24.241819 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f1822-8f55-4e4c-a3ca-1def694f2c01 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:24.242115 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f1822-8f55-4e4c-a3ca-1def694f2c01 None admin] PATH_INFO: `/v3/users` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:24.242980 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f1822-8f55-4e4c-a3ca-1def694f2c01 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:24.243290 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f1822-8f55-4e4c-a3ca-1def694f2c01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:24.244757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f1822-8f55-4e4c-a3ca-1def694f2c01 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:24.266778 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 433/848] 10.222.0.64 () {56 vars in 1143 bytes} [Thu May 12 16:55:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:24.268169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecba5d4-20f8-4bb2-8c3c-e83c35e9866a None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:24.370533 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecba5d4-20f8-4bb2-8c3c-e83c35e9866a None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:24.406107 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71aef9-a961-4f73-a9f7-f3371a488d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:24.406907 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71aef9-a961-4f73-a9f7-f3371a488d6d None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:24.407183 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71aef9-a961-4f73-a9f7-f3371a488d6d None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:24.407502 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71aef9-a961-4f73-a9f7-f3371a488d6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:24.421346 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71aef9-a961-4f73-a9f7-f3371a488d6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:24.423055 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71aef9-a961-4f73-a9f7-f3371a488d6d None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:24.442144 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-5e71aef9-a961-4f73-a9f7-f3371a488d6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:24.442144 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:24.442144 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:24.442144 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:24.442144 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:24.442144 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:24.442144 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:24.442144 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:24.442144 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:24.442144 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:24.442144 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:24.442144 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:24.442144 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:55:24.442144 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:55:24.442144 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:55:24.443088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:55:24.443088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:24.443088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:24.443088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:24.443088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:24.443088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:24.443088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:24.443088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:24.443088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:55:24.443088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:24.443088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:24.443088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:24.443088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:24.443088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:24.443088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:24.443088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:24.443088 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:24.444021 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:55:24.444021 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:55:24.444021 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:24.444021 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:24.444021 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 416/849] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:55:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:24.450445 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f1822-8f55-4e4c-a3ca-1def694f2c01 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:24.564365 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f1822-8f55-4e4c-a3ca-1def694f2c01 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:24.610110 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a4286-4b23-4d11-90d2-a6a5b953c571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:24.610765 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a4286-4b23-4d11-90d2-a6a5b953c571 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:24.611080 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a4286-4b23-4d11-90d2-a6a5b953c571 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:24.611351 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a4286-4b23-4d11-90d2-a6a5b953c571 None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:24.612128 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a4286-4b23-4d11-90d2-a6a5b953c571 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:24.612446 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a4286-4b23-4d11-90d2-a6a5b953c571 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:24.613871 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a4286-4b23-4d11-90d2-a6a5b953c571 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:24.633047 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 434/850] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:55:24.634476 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71aef9-a961-4f73-a9f7-f3371a488d6d None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:24.739619 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71aef9-a961-4f73-a9f7-f3371a488d6d None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:24.776202 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ac106-b22b-4eb9-b951-5d4f21407276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:24.777040 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ac106-b22b-4eb9-b951-5d4f21407276 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:24.777355 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ac106-b22b-4eb9-b951-5d4f21407276 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:24.777675 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ac106-b22b-4eb9-b951-5d4f21407276 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:24.784747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ac106-b22b-4eb9-b951-5d4f21407276 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:24.786449 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ac106-b22b-4eb9-b951-5d4f21407276 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:24.801773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-551ac106-b22b-4eb9-b951-5d4f21407276 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:55:24.801773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:24.801773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:24.801773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:24.801773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:24.801773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:24.801773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:24.801773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:24.801773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:24.801773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:24.801773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:24.801773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:24.801773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:55:24.801773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:55:24.801773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:55:24.802719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:55:24.802719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:24.802719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:24.802719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:24.802719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:24.802719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:24.802719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:24.802719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:24.802719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:55:24.802719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:24.802719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:24.802719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:24.802719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:24.802719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:24.802719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:24.802719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:24.802719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:24.803594 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:55:24.803594 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:55:24.803594 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:55:24.803594 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:55:24.803594 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:55:24.803594 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:55:24.803594 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:55:24.803594 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:24.803594 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 417/851] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:55:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:24.810228 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a4286-4b23-4d11-90d2-a6a5b953c571 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:24.917147 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a4286-4b23-4d11-90d2-a6a5b953c571 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:24.954021 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6809f5-7c8d-4a2b-8a69-c809bd52a3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:24.954708 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6809f5-7c8d-4a2b-8a69-c809bd52a3c0 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:24.954991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6809f5-7c8d-4a2b-8a69-c809bd52a3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:24.956453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6809f5-7c8d-4a2b-8a69-c809bd52a3c0 None admin] PATH_INFO: `/v3/projects` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:24.956453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6809f5-7c8d-4a2b-8a69-c809bd52a3c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:24.956453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6809f5-7c8d-4a2b-8a69-c809bd52a3c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:24.957806 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6809f5-7c8d-4a2b-8a69-c809bd52a3c0 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:24.972261 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 435/852] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:55:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:24.979594 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ac106-b22b-4eb9-b951-5d4f21407276 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:25.086951 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ac106-b22b-4eb9-b951-5d4f21407276 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:25.124628 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b1926-63bd-4625-b6da-74cdfc5e7470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:25.125507 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b1926-63bd-4625-b6da-74cdfc5e7470 None admin] REQUEST_METHOD: `PUT` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:25.125785 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b1926-63bd-4625-b6da-74cdfc5e7470 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:25.126056 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b1926-63bd-4625-b6da-74cdfc5e7470 None admin] PATH_INFO: `/v3/projects/d2ccefb3ecb0493bb0240a3853bfa5ff/users/8c64a6e5ef494d00817bb47cd6fd2bc4/roles/0f1a9958b7874b10b41712760f0b6ffa` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:25.143694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b1926-63bd-4625-b6da-74cdfc5e7470 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2ccefb3ecb0493bb0240a3853bfa5ff, user_id=8c64a6e5ef494d00817bb47cd6fd2bc4, role_id=0f1a9958b7874b10b41712760f0b6ffa)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:25.145529 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b1926-63bd-4625-b6da-74cdfc5e7470 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:25.158816 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 418/853] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 12 16:55:24 2022] PUT /identity/v3/projects/d2ccefb3ecb0493bb0240a3853bfa5ff/users/8c64a6e5ef494d00817bb47cd6fd2bc4/roles/0f1a9958b7874b10b41712760f0b6ffa => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:55:27.568365 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14aa10-5cbf-4981-9387-73ea695bff62 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:27.568928 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14aa10-5cbf-4981-9387-73ea695bff62 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:27.568928 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14aa10-5cbf-4981-9387-73ea695bff62 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:27.570358 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 436/854] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:55:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:55:27.576333 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440729-1a40-4e8b-8fca-4152e2b1b67e None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:27.576771 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440729-1a40-4e8b-8fca-4152e2b1b67e None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:27.577053 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440729-1a40-4e8b-8fca-4152e2b1b67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:27.594829 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-80440729-1a40-4e8b-8fca-4152e2b1b67e None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:55:27.596131 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-80440729-1a40-4e8b-8fca-4152e2b1b67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:55:27.667202 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 419/855] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:55:27 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:55:27.694446 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14aa10-5cbf-4981-9387-73ea695bff62 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:27.797694 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14aa10-5cbf-4981-9387-73ea695bff62 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:27.831732 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b95f8b-a693-43cf-a44b-eec0e61a09fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:27.832470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b95f8b-a693-43cf-a44b-eec0e61a09fb None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:27.832748 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b95f8b-a693-43cf-a44b-eec0e61a09fb None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:27.833018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b95f8b-a693-43cf-a44b-eec0e61a09fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:27.843421 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b95f8b-a693-43cf-a44b-eec0e61a09fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:55:27.851430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-29b95f8b-a693-43cf-a44b-eec0e61a09fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 16:55:27.851430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:27.851430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:27.851430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:27.851430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:27.851430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:27.851430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:27.851430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:27.851430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:27.851430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:27.851430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:27.851430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:27.851430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:55:27.851430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:55:27.851430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:55:27.851430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:55:27.852618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:55:27.852618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:55:27.852618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:55:27.852618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:55:27.852618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:27.852618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:27.852618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:27.852618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:27.852618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:27.852618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:27.852618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:27.852618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:55:27.852618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:27.852618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:27.852618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:27.852618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:27.853668 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:27.853668 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:27.853668 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:27.853668 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:27.853668 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:55:27.853668 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:55:27.853668 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:55:27.853668 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:55:27.853668 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:55:27.853668 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:55:27.853668 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 16:55:27.853668 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:55:27.853668 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 437/856] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 12 16:55:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:27.858818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80440729-1a40-4e8b-8fca-4152e2b1b67e None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:27.969982 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80440729-1a40-4e8b-8fca-4152e2b1b67e None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:28.012016 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c9f9e-6bce-4ebe-b32c-b4d3a349f5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:28.012695 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c9f9e-6bce-4ebe-b32c-b4d3a349f5be None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:28.012972 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c9f9e-6bce-4ebe-b32c-b4d3a349f5be None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:28.013245 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c9f9e-6bce-4ebe-b32c-b4d3a349f5be None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:28.014004 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c9f9e-6bce-4ebe-b32c-b4d3a349f5be None admin] RBAC: Adding query filter params (name=service) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:28.014311 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c9f9e-6bce-4ebe-b32c-b4d3a349f5be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:28.015773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c9f9e-6bce-4ebe-b32c-b4d3a349f5be None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:28.024682 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 420/857] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 12 16:55:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:28.030340 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b95f8b-a693-43cf-a44b-eec0e61a09fb None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:28.130960 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b95f8b-a693-43cf-a44b-eec0e61a09fb None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:28.166466 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d1673-24c7-4772-b489-52ee5a12b837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:28.167327 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d1673-24c7-4772-b489-52ee5a12b837 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:28.167623 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d1673-24c7-4772-b489-52ee5a12b837 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:28.167953 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d1673-24c7-4772-b489-52ee5a12b837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:28.178808 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d1673-24c7-4772-b489-52ee5a12b837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:28.180878 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d1673-24c7-4772-b489-52ee5a12b837 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:28.197469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-169d1673-24c7-4772-b489-52ee5a12b837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:28.197469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:28.197469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:28.197469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:28.197469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:28.197469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:28.197469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:28.197469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:28.197469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:28.197469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:28.197469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:28.197469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:28.197469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:55:28.197469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:55:28.197469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:55:28.198426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:55:28.198426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:28.198426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:28.198426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:28.198426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:28.198426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:28.198426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:28.198426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:28.198426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:55:28.198426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:28.198426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:28.198426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:28.198426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:28.198426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:28.198426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:28.198426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:28.198426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:28.200821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:55:28.200821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:55:28.200821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:28.200821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:55:28.200821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 438/858] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:55:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:28.205166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c9f9e-6bce-4ebe-b32c-b4d3a349f5be None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:28.312656 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c9f9e-6bce-4ebe-b32c-b4d3a349f5be None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:28.350330 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620107b3-0a3a-4891-a5da-06cc6109faba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:28.351030 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620107b3-0a3a-4891-a5da-06cc6109faba None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:28.351351 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620107b3-0a3a-4891-a5da-06cc6109faba None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:28.351699 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620107b3-0a3a-4891-a5da-06cc6109faba None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:28.352466 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620107b3-0a3a-4891-a5da-06cc6109faba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:28.352815 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620107b3-0a3a-4891-a5da-06cc6109faba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:28.354298 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620107b3-0a3a-4891-a5da-06cc6109faba None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:28.369126 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 421/859] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:28.374652 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d1673-24c7-4772-b489-52ee5a12b837 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:28.495970 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d1673-24c7-4772-b489-52ee5a12b837 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:28.536051 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a577e04-eb8d-41ff-ae7c-7822a914a59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:28.536978 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a577e04-eb8d-41ff-ae7c-7822a914a59f None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:28.537457 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a577e04-eb8d-41ff-ae7c-7822a914a59f None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:28.537898 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a577e04-eb8d-41ff-ae7c-7822a914a59f None admin] PATH_INFO: `/v3/users/placement` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:28.546511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a577e04-eb8d-41ff-ae7c-7822a914a59f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:28.547995 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a577e04-eb8d-41ff-ae7c-7822a914a59f None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:28.563145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-3a577e04-eb8d-41ff-ae7c-7822a914a59f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 16:55:28.563145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:28.563145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:28.563145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:28.563145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:28.563145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:28.563145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:28.563145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:28.563145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:28.563145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:28.563145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:28.563145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:28.563145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:55:28.563145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:55:28.563145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:55:28.563145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:55:28.564312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:28.564312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:28.564312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:55:28.564312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:55:28.564312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:55:28.564312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:55:28.564312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:28.564312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:28.564312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:28.564312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:28.564312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:28.564312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:55:28.564312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:28.564312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:28.564312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:28.564312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:28.564312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:28.564312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:28.571482 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:28.571482 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:28.571482 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:55:28.571482 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:55:28.571482 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:55:28.571482 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:55:28.571482 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:55:28.571482 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:55:28.571482 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 16:55:28.571482 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:55:28.571482 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 439/860] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:55:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:28.572089 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620107b3-0a3a-4891-a5da-06cc6109faba None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:28.682028 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620107b3-0a3a-4891-a5da-06cc6109faba None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:28.718964 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec65e0d-3916-4b61-bc08-c830842f0480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:28.719652 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec65e0d-3916-4b61-bc08-c830842f0480 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:28.719934 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec65e0d-3916-4b61-bc08-c830842f0480 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:28.720216 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec65e0d-3916-4b61-bc08-c830842f0480 None admin] PATH_INFO: `/v3/users` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:28.721019 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec65e0d-3916-4b61-bc08-c830842f0480 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:28.721323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec65e0d-3916-4b61-bc08-c830842f0480 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:28.722803 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec65e0d-3916-4b61-bc08-c830842f0480 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:28.741360 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 422/861] 10.222.0.64 () {56 vars in 1143 bytes} [Thu May 12 16:55:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:28.747625 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a577e04-eb8d-41ff-ae7c-7822a914a59f None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:28.853076 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a577e04-eb8d-41ff-ae7c-7822a914a59f None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:28.887753 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023867b-399c-4342-8099-5ca4ccf43978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:28.888409 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023867b-399c-4342-8099-5ca4ccf43978 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:28.888691 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023867b-399c-4342-8099-5ca4ccf43978 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:28.888992 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023867b-399c-4342-8099-5ca4ccf43978 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:28.959911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023867b-399c-4342-8099-5ca4ccf43978 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:28.961554 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023867b-399c-4342-8099-5ca4ccf43978 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:29.082594 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 440/862] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:55:28 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 16:55:29.088263 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec65e0d-3916-4b61-bc08-c830842f0480 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:29.197706 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec65e0d-3916-4b61-bc08-c830842f0480 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:29.237585 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c993a55-e6c3-4818-b688-219e3a8de022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:29.238465 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c993a55-e6c3-4818-b688-219e3a8de022 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:29.238747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c993a55-e6c3-4818-b688-219e3a8de022 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:29.239020 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c993a55-e6c3-4818-b688-219e3a8de022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:29.249396 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c993a55-e6c3-4818-b688-219e3a8de022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:29.250984 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c993a55-e6c3-4818-b688-219e3a8de022 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:29.272011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-0c993a55-e6c3-4818-b688-219e3a8de022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:29.272011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:29.272011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:29.272011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:29.272011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:29.272011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:29.272011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:29.272011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:29.272011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:29.272011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:29.272011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:29.272011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:29.272011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:55:29.272011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:55:29.272011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:55:29.273166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:55:29.273166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:29.273166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:29.273166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:29.273166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:29.273166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:29.273166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:29.273166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:29.273166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:55:29.273166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:29.273166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:29.273166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:29.273166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:29.273166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:29.273166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:29.273166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:29.273166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:29.274223 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:55:29.274223 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:55:29.274223 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:29.274223 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:29.274223 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 423/863] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:55:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:29.279262 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023867b-399c-4342-8099-5ca4ccf43978 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:29.384952 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023867b-399c-4342-8099-5ca4ccf43978 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:29.422570 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90b6eb-d6f5-4284-a8bf-75371a0f0442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:29.423278 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90b6eb-d6f5-4284-a8bf-75371a0f0442 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:29.423554 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90b6eb-d6f5-4284-a8bf-75371a0f0442 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:29.423914 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90b6eb-d6f5-4284-a8bf-75371a0f0442 None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:29.424628 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90b6eb-d6f5-4284-a8bf-75371a0f0442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:29.424931 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90b6eb-d6f5-4284-a8bf-75371a0f0442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:29.426296 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90b6eb-d6f5-4284-a8bf-75371a0f0442 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:29.437692 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 441/864] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:29.443463 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c993a55-e6c3-4818-b688-219e3a8de022 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:29.550798 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c993a55-e6c3-4818-b688-219e3a8de022 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:29.590376 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d750806-b274-46e8-b959-a8dd7efbb819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:29.591189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d750806-b274-46e8-b959-a8dd7efbb819 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:29.591543 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d750806-b274-46e8-b959-a8dd7efbb819 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:29.591841 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d750806-b274-46e8-b959-a8dd7efbb819 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:29.600154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d750806-b274-46e8-b959-a8dd7efbb819 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:29.602729 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d750806-b274-46e8-b959-a8dd7efbb819 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:29.617189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-6d750806-b274-46e8-b959-a8dd7efbb819 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:55:29.617189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:29.617189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:29.617189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:29.617189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:29.617189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:29.617189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:29.617189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:29.617189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:29.617189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:29.617189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:29.617189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:29.617189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:55:29.617189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:55:29.617189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:55:29.618348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:55:29.618348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:29.618348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:29.618348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:29.618348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:29.618348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:29.618348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:29.618348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:29.618348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:55:29.618348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:29.618348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:29.618348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:29.618348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:29.618348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:29.618348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:29.618348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:29.618348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:29.619329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:55:29.619329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:55:29.619329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:55:29.619329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:55:29.619329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:55:29.619329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:55:29.619329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:55:29.619329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:29.619329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 424/865] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:55:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:29.624419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90b6eb-d6f5-4284-a8bf-75371a0f0442 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:29.720847 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90b6eb-d6f5-4284-a8bf-75371a0f0442 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:29.754064 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9be15-5309-443a-a6d3-d88b46bbdeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:29.754723 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9be15-5309-443a-a6d3-d88b46bbdeed None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:29.755007 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9be15-5309-443a-a6d3-d88b46bbdeed None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:29.755285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9be15-5309-443a-a6d3-d88b46bbdeed None admin] PATH_INFO: `/v3/projects` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:29.756100 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9be15-5309-443a-a6d3-d88b46bbdeed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:29.756410 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9be15-5309-443a-a6d3-d88b46bbdeed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:29.757880 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9be15-5309-443a-a6d3-d88b46bbdeed None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:29.770609 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 442/866] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:55:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:55:29.776704 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d750806-b274-46e8-b959-a8dd7efbb819 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:29.887502 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d750806-b274-46e8-b959-a8dd7efbb819 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:29.922282 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85396e72-d679-486a-a654-003162255b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:29.922976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85396e72-d679-486a-a654-003162255b88 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:29.923234 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85396e72-d679-486a-a654-003162255b88 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:29.923506 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85396e72-d679-486a-a654-003162255b88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:29.924409 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85396e72-d679-486a-a654-003162255b88 None admin] RBAC: Adding query filter params (role.id=0f1a9958b7874b10b41712760f0b6ffa, scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff, user.id=8c64a6e5ef494d00817bb47cd6fd2bc4) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:29.924686 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85396e72-d679-486a-a654-003162255b88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:29.926148 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85396e72-d679-486a-a654-003162255b88 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:29.933053 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 425/867] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:55:29 2022] GET /identity/v3/role_assignments?user.id=8c64a6e5ef494d00817bb47cd6fd2bc4&scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff&role.id=0f1a9958b7874b10b41712760f0b6ffa => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:32.381570 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79d590-fd45-466e-8b8d-3224074219cf None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:32.382095 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79d590-fd45-466e-8b8d-3224074219cf None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:32.382186 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79d590-fd45-466e-8b8d-3224074219cf None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:32.383542 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 443/868] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:55:32.390553 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb65dee-df49-4460-a4da-92b03c2ba60c None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:32.391076 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb65dee-df49-4460-a4da-92b03c2ba60c None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:32.391076 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb65dee-df49-4460-a4da-92b03c2ba60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:32.410729 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-fcb65dee-df49-4460-a4da-92b03c2ba60c None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:55:32.411963 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-fcb65dee-df49-4460-a4da-92b03c2ba60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:55:32.487973 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 426/869] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:55:32 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:55:32.513365 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79d590-fd45-466e-8b8d-3224074219cf None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:32.634216 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79d590-fd45-466e-8b8d-3224074219cf None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:32.672359 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3ed35-6d8e-49a6-8da8-f9da512e284f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:32.673350 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3ed35-6d8e-49a6-8da8-f9da512e284f None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:32.673616 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3ed35-6d8e-49a6-8da8-f9da512e284f None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:32.673870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3ed35-6d8e-49a6-8da8-f9da512e284f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:32.689729 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3ed35-6d8e-49a6-8da8-f9da512e284f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:55:32.699943 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-9ec3ed35-6d8e-49a6-8da8-f9da512e284f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:55:32.699943 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:32.699943 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:32.699943 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:32.699943 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:32.699943 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:32.699943 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:32.699943 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:32.699943 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:32.699943 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:32.699943 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:32.699943 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:32.699943 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:55:32.699943 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:55:32.699943 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:55:32.699943 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:55:32.701094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:55:32.701094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:55:32.701094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:55:32.701094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:55:32.701094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:32.701094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:32.701094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:32.701094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:32.701094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:32.701094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:32.701094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:32.701094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:55:32.701094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:32.701094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:32.701094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:32.701094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:32.701940 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:32.701940 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:32.701940 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:32.701940 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:32.701940 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:55:32.701940 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:55:32.701940 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:55:32.701940 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:55:32.701940 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:55:32.701940 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:55:32.701940 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:55:32.701940 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:55:32.701940 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 444/870] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 12 16:55:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:32.709271 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb65dee-df49-4460-a4da-92b03c2ba60c None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:32.822169 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb65dee-df49-4460-a4da-92b03c2ba60c None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:32.860220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315bd36-bd63-4ae7-bff1-c96557e3c7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:32.860887 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315bd36-bd63-4ae7-bff1-c96557e3c7d6 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:32.861182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315bd36-bd63-4ae7-bff1-c96557e3c7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:32.861446 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315bd36-bd63-4ae7-bff1-c96557e3c7d6 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:32.862299 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315bd36-bd63-4ae7-bff1-c96557e3c7d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:32.862661 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315bd36-bd63-4ae7-bff1-c96557e3c7d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:32.864118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315bd36-bd63-4ae7-bff1-c96557e3c7d6 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:32.872886 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 427/871] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:55:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:32.878880 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3ed35-6d8e-49a6-8da8-f9da512e284f None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:32.986052 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3ed35-6d8e-49a6-8da8-f9da512e284f None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:33.019412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ebd57-4bfb-4db9-a9ba-933a5d5491c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:33.020310 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ebd57-4bfb-4db9-a9ba-933a5d5491c5 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:33.020579 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ebd57-4bfb-4db9-a9ba-933a5d5491c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:33.020854 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ebd57-4bfb-4db9-a9ba-933a5d5491c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:33.033406 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ebd57-4bfb-4db9-a9ba-933a5d5491c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:33.035076 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ebd57-4bfb-4db9-a9ba-933a5d5491c5 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:33.052894 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-4e1ebd57-4bfb-4db9-a9ba-933a5d5491c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:33.052894 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:33.052894 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:33.052894 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:33.052894 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:33.052894 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:33.052894 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:33.052894 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:33.052894 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:33.052894 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:33.052894 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:33.052894 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:33.052894 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:55:33.052894 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:55:33.052894 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:55:33.055232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:55:33.055232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:33.055232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:33.055232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:33.055232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:33.055232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:33.055232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:33.055232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:33.055232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:55:33.055232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:33.055232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:33.055232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:33.055232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:33.055232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:33.055232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:33.055232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:33.055232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:33.056469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:55:33.056469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:55:33.056469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:33.056469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:55:33.056469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 445/872] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:55:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:33.061492 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315bd36-bd63-4ae7-bff1-c96557e3c7d6 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:33.173740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315bd36-bd63-4ae7-bff1-c96557e3c7d6 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:33.208233 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd5102-ae51-4e79-bff5-ab92937d0110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:33.208943 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5102-ae51-4e79-bff5-ab92937d0110 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:33.209177 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5102-ae51-4e79-bff5-ab92937d0110 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:33.209459 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5102-ae51-4e79-bff5-ab92937d0110 None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:33.210151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd5102-ae51-4e79-bff5-ab92937d0110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:33.210474 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd5102-ae51-4e79-bff5-ab92937d0110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:33.211851 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd5102-ae51-4e79-bff5-ab92937d0110 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:33.224251 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 428/873] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:55:33.229927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ebd57-4bfb-4db9-a9ba-933a5d5491c5 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:33.338304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ebd57-4bfb-4db9-a9ba-933a5d5491c5 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:33.373318 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a84d2b-e8d6-4baf-a4f7-93e789f5bab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:33.374349 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a84d2b-e8d6-4baf-a4f7-93e789f5bab1 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:33.374638 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a84d2b-e8d6-4baf-a4f7-93e789f5bab1 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:33.374970 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a84d2b-e8d6-4baf-a4f7-93e789f5bab1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:33.382996 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a84d2b-e8d6-4baf-a4f7-93e789f5bab1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:33.384870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a84d2b-e8d6-4baf-a4f7-93e789f5bab1 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:33.400004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-a8a84d2b-e8d6-4baf-a4f7-93e789f5bab1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 16:55:33.400004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:33.400004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:33.400004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:33.400004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:33.400004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:33.400004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:33.400004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:33.400004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:33.400004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:33.400004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:33.400004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:33.400004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:55:33.400004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:55:33.400004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:55:33.400004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:55:33.400994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:33.400994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:33.400994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:55:33.400994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:55:33.400994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:55:33.400994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:55:33.400994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:33.400994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:33.400994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:33.400994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:33.400994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:33.400994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:55:33.400994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:33.400994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:33.400994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:33.400994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:33.400994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:33.400994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:33.401916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:33.401916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:33.401916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:55:33.401916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:55:33.401916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:55:33.401916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:55:33.401916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:55:33.401916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:55:33.401916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 16:55:33.401916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:55:33.401916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 446/874] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:55:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:33.407126 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd5102-ae51-4e79-bff5-ab92937d0110 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:33.514969 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd5102-ae51-4e79-bff5-ab92937d0110 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:33.550824 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9808fd-b366-4cc1-ace0-39055fbf2414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:33.551515 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9808fd-b366-4cc1-ace0-39055fbf2414 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:33.551823 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9808fd-b366-4cc1-ace0-39055fbf2414 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:33.552091 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9808fd-b366-4cc1-ace0-39055fbf2414 None admin] PATH_INFO: `/v3/users` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:33.552921 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9808fd-b366-4cc1-ace0-39055fbf2414 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:33.553255 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9808fd-b366-4cc1-ace0-39055fbf2414 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:33.554671 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9808fd-b366-4cc1-ace0-39055fbf2414 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:33.575673 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 429/875] 10.222.0.64 () {56 vars in 1143 bytes} [Thu May 12 16:55:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:33.581703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a84d2b-e8d6-4baf-a4f7-93e789f5bab1 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:33.692969 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a84d2b-e8d6-4baf-a4f7-93e789f5bab1 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:33.728693 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5b7fb-7ce3-4987-8970-d9a6f91dbf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:33.729357 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5b7fb-7ce3-4987-8970-d9a6f91dbf1b None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:33.729643 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5b7fb-7ce3-4987-8970-d9a6f91dbf1b None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:33.729922 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5b7fb-7ce3-4987-8970-d9a6f91dbf1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:33.800069 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5b7fb-7ce3-4987-8970-d9a6f91dbf1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:33.801465 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5b7fb-7ce3-4987-8970-d9a6f91dbf1b None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:33.906692 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 447/876] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:55:33 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 16:55:33.908164 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9808fd-b366-4cc1-ace0-39055fbf2414 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:34.010119 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9808fd-b366-4cc1-ace0-39055fbf2414 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:34.042401 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0ac4e-ec86-496b-a802-542cc1d4d892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:34.043186 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0ac4e-ec86-496b-a802-542cc1d4d892 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:34.043464 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0ac4e-ec86-496b-a802-542cc1d4d892 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:34.043768 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0ac4e-ec86-496b-a802-542cc1d4d892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:34.053701 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0ac4e-ec86-496b-a802-542cc1d4d892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:34.055599 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0ac4e-ec86-496b-a802-542cc1d4d892 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:34.073213 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-1bb0ac4e-ec86-496b-a802-542cc1d4d892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:34.073213 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:34.073213 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:34.073213 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:34.073213 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:34.073213 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:34.073213 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:34.073213 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:34.073213 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:34.073213 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:34.073213 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:34.073213 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:34.073213 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:55:34.073213 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:55:34.073213 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:55:34.074285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:55:34.074285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:34.074285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:34.074285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:34.074285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:34.074285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:34.074285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:34.074285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:34.074285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:55:34.074285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:34.074285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:34.074285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:34.074285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:34.074285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:34.074285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:34.074285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:34.074285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:34.075330 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:55:34.075330 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:55:34.075330 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:34.075330 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:34.075330 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 430/877] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:55:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:34.080372 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5b7fb-7ce3-4987-8970-d9a6f91dbf1b None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:34.177651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5b7fb-7ce3-4987-8970-d9a6f91dbf1b None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:34.211701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ad220-4519-4f53-b458-a4b36f78e3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:34.212366 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ad220-4519-4f53-b458-a4b36f78e3f5 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:34.212649 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ad220-4519-4f53-b458-a4b36f78e3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:34.212921 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ad220-4519-4f53-b458-a4b36f78e3f5 None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:34.213641 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ad220-4519-4f53-b458-a4b36f78e3f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:34.213944 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ad220-4519-4f53-b458-a4b36f78e3f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:34.215308 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ad220-4519-4f53-b458-a4b36f78e3f5 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:34.226753 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 448/878] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:34.232353 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0ac4e-ec86-496b-a802-542cc1d4d892 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:34.326683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0ac4e-ec86-496b-a802-542cc1d4d892 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:34.358625 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df7bb6-160f-406f-9cb0-fb7be55a6fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:34.359395 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df7bb6-160f-406f-9cb0-fb7be55a6fbb None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:34.359700 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df7bb6-160f-406f-9cb0-fb7be55a6fbb None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:34.359976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df7bb6-160f-406f-9cb0-fb7be55a6fbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:34.366341 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df7bb6-160f-406f-9cb0-fb7be55a6fbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:34.367801 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df7bb6-160f-406f-9cb0-fb7be55a6fbb None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:34.380962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-00df7bb6-160f-406f-9cb0-fb7be55a6fbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:55:34.380962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:34.380962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:34.380962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:34.380962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:34.380962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:34.380962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:34.380962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:34.380962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:34.380962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:34.380962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:34.380962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:34.380962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:55:34.380962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:55:34.380962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:55:34.382501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:55:34.382501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:34.382501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:34.382501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:34.382501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:34.382501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:34.382501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:34.382501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:34.382501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:55:34.382501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:34.382501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:34.382501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:34.382501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:34.382501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:34.382501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:34.382501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:34.382501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:34.383793 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:55:34.383793 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:55:34.383793 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:55:34.383793 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:55:34.383793 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:55:34.383793 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:55:34.383793 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:55:34.383793 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:34.383793 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 431/879] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:55:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:34.388494 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ad220-4519-4f53-b458-a4b36f78e3f5 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:34.481888 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ad220-4519-4f53-b458-a4b36f78e3f5 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:34.513162 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a50a2-fa92-4486-9e40-b46f9fbb5711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:34.513803 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a50a2-fa92-4486-9e40-b46f9fbb5711 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:34.514081 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a50a2-fa92-4486-9e40-b46f9fbb5711 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:34.514354 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a50a2-fa92-4486-9e40-b46f9fbb5711 None admin] PATH_INFO: `/v3/projects` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:34.515163 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a50a2-fa92-4486-9e40-b46f9fbb5711 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:34.515467 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a50a2-fa92-4486-9e40-b46f9fbb5711 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:34.516923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a50a2-fa92-4486-9e40-b46f9fbb5711 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:34.528874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 449/880] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:55:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:34.534708 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df7bb6-160f-406f-9cb0-fb7be55a6fbb None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:34.644126 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df7bb6-160f-406f-9cb0-fb7be55a6fbb None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:34.675542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fc7c8-3587-463a-b405-20c1327b6427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:34.676208 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fc7c8-3587-463a-b405-20c1327b6427 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:34.676485 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fc7c8-3587-463a-b405-20c1327b6427 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:34.676755 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fc7c8-3587-463a-b405-20c1327b6427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:34.677559 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fc7c8-3587-463a-b405-20c1327b6427 None admin] RBAC: Adding query filter params (role.id=fbd6364b42a641f695c0b265a789057a, scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff, user.id=8c64a6e5ef494d00817bb47cd6fd2bc4) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:34.677864 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fc7c8-3587-463a-b405-20c1327b6427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:34.679317 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fc7c8-3587-463a-b405-20c1327b6427 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:34.684460 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 432/881] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:55:34 2022] GET /identity/v3/role_assignments?user.id=8c64a6e5ef494d00817bb47cd6fd2bc4&scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff&role.id=fbd6364b42a641f695c0b265a789057a => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:55:36.962285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2741ead-e6eb-43cb-9797-e2fd6a55855e None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:36.962839 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2741ead-e6eb-43cb-9797-e2fd6a55855e None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:36.962839 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2741ead-e6eb-43cb-9797-e2fd6a55855e None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:36.964219 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 450/882] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:55:36.969454 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db86fd-181c-41ea-a0f1-73cf55f911b8 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:36.969877 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db86fd-181c-41ea-a0f1-73cf55f911b8 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:36.970008 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db86fd-181c-41ea-a0f1-73cf55f911b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:36.986348 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-a8db86fd-181c-41ea-a0f1-73cf55f911b8 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:55:36.987514 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-a8db86fd-181c-41ea-a0f1-73cf55f911b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:55:37.049901 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 433/883] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:55:36 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:55:37.073970 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2741ead-e6eb-43cb-9797-e2fd6a55855e None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:37.170358 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2741ead-e6eb-43cb-9797-e2fd6a55855e None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:37.201649 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66489e96-1f73-411b-9768-5863b1739d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:37.202418 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66489e96-1f73-411b-9768-5863b1739d5b None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:37.202697 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66489e96-1f73-411b-9768-5863b1739d5b None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:37.202968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66489e96-1f73-411b-9768-5863b1739d5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:37.212491 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66489e96-1f73-411b-9768-5863b1739d5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:55:37.220056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-66489e96-1f73-411b-9768-5863b1739d5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:55:37.220056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:37.220056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:37.220056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:37.220056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:37.220056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:37.220056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:37.220056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:37.220056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:37.220056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:37.220056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:37.220056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:37.220056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:55:37.220056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:55:37.220056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:55:37.220056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:55:37.221173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:55:37.221173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:55:37.221173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:55:37.221173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:55:37.221173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:37.221173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:37.221173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:37.221173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:37.221173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:37.221173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:37.221173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:37.221173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:55:37.221173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:37.221173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:37.221173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:37.221173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:37.222265 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:37.222265 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:37.222265 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:37.222265 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:37.222265 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:55:37.222265 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:55:37.222265 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:55:37.222265 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:55:37.222265 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:55:37.222265 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:55:37.222265 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:55:37.222265 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:55:37.222265 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 451/884] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 12 16:55:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:37.227867 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db86fd-181c-41ea-a0f1-73cf55f911b8 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:37.318511 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db86fd-181c-41ea-a0f1-73cf55f911b8 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:37.349614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cf64f-bc33-48a3-b79c-75af5a6f7aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:37.350260 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cf64f-bc33-48a3-b79c-75af5a6f7aa0 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:37.351049 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cf64f-bc33-48a3-b79c-75af5a6f7aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:37.351323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cf64f-bc33-48a3-b79c-75af5a6f7aa0 None admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:37.352080 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cf64f-bc33-48a3-b79c-75af5a6f7aa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:37.352381 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cf64f-bc33-48a3-b79c-75af5a6f7aa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:37.353737 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cf64f-bc33-48a3-b79c-75af5a6f7aa0 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:37.361242 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 434/885] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:55:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:37.367542 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66489e96-1f73-411b-9768-5863b1739d5b None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:37.461109 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66489e96-1f73-411b-9768-5863b1739d5b None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:37.492414 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb962f0-76e5-4ff0-937c-01eedba1039d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:37.493180 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb962f0-76e5-4ff0-937c-01eedba1039d None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:37.493464 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb962f0-76e5-4ff0-937c-01eedba1039d None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:37.493738 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb962f0-76e5-4ff0-937c-01eedba1039d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:37.503576 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb962f0-76e5-4ff0-937c-01eedba1039d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:37.505051 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb962f0-76e5-4ff0-937c-01eedba1039d None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:37.521809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-3bb962f0-76e5-4ff0-937c-01eedba1039d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:37.521809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:37.521809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:37.521809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:37.521809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:37.521809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:37.521809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:37.521809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:37.521809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:37.521809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:37.521809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:37.521809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:37.521809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:55:37.521809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:55:37.521809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:55:37.523412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:55:37.523412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:37.523412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:37.523412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:37.523412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:37.523412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:37.523412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:37.523412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:37.523412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:55:37.523412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:37.523412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:37.523412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:37.523412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:37.523412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:37.523412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:37.523412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:37.523412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:37.524646 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:55:37.524646 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:55:37.524646 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:37.524646 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:55:37.524646 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 452/886] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:37.529100 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cf64f-bc33-48a3-b79c-75af5a6f7aa0 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:37.626284 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cf64f-bc33-48a3-b79c-75af5a6f7aa0 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:37.657941 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b924bd-882f-41de-aafd-e2bebda648b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:37.658594 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b924bd-882f-41de-aafd-e2bebda648b0 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:37.658876 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b924bd-882f-41de-aafd-e2bebda648b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:37.659152 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b924bd-882f-41de-aafd-e2bebda648b0 None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:37.659900 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b924bd-882f-41de-aafd-e2bebda648b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:37.660206 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b924bd-882f-41de-aafd-e2bebda648b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:37.661598 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b924bd-882f-41de-aafd-e2bebda648b0 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:37.672702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 435/887] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:37.678401 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb962f0-76e5-4ff0-937c-01eedba1039d None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:37.772208 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb962f0-76e5-4ff0-937c-01eedba1039d None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:37.802751 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88875588-80f6-4d69-beac-eabe74cb3e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:37.803538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88875588-80f6-4d69-beac-eabe74cb3e68 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:37.804352 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88875588-80f6-4d69-beac-eabe74cb3e68 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:37.804621 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88875588-80f6-4d69-beac-eabe74cb3e68 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:37.812195 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88875588-80f6-4d69-beac-eabe74cb3e68 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:37.813675 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88875588-80f6-4d69-beac-eabe74cb3e68 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:37.828108 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-88875588-80f6-4d69-beac-eabe74cb3e68 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 16:55:37.828108 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:37.828108 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:37.828108 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:37.828108 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:37.828108 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:37.828108 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:37.828108 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:37.828108 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:37.828108 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:37.828108 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:37.828108 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:37.828108 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:55:37.828108 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:55:37.828108 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:55:37.828108 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:55:37.829242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:37.829242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:37.829242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:55:37.829242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:55:37.829242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:55:37.829242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:55:37.829242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:37.829242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:37.829242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:37.829242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:37.829242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:37.829242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:55:37.829242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:37.829242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:37.829242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:37.829242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:37.829242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:37.829242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:37.835284 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:37.835284 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:37.835284 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:55:37.835284 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:55:37.835284 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:55:37.835284 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:55:37.835284 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:55:37.835284 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:55:37.835284 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 16:55:37.835284 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:55:37.835284 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 453/888] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:55:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:37.836082 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b924bd-882f-41de-aafd-e2bebda648b0 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:37.929674 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b924bd-882f-41de-aafd-e2bebda648b0 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:37.960997 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0ee38-69c6-4ac7-8016-cbd9812b23f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:37.961651 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0ee38-69c6-4ac7-8016-cbd9812b23f8 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:37.961933 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0ee38-69c6-4ac7-8016-cbd9812b23f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:37.962208 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0ee38-69c6-4ac7-8016-cbd9812b23f8 None admin] PATH_INFO: `/v3/users` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:37.963032 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0ee38-69c6-4ac7-8016-cbd9812b23f8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:37.963343 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0ee38-69c6-4ac7-8016-cbd9812b23f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:37.964810 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0ee38-69c6-4ac7-8016-cbd9812b23f8 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:37.981534 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 436/889] 10.222.0.64 () {56 vars in 1143 bytes} [Thu May 12 16:55:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:37.987201 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88875588-80f6-4d69-beac-eabe74cb3e68 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:38.080989 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88875588-80f6-4d69-beac-eabe74cb3e68 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:38.112688 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908243c4-b93a-46c2-b02d-bbea40b75d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:38.113466 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908243c4-b93a-46c2-b02d-bbea40b75d93 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:38.113764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908243c4-b93a-46c2-b02d-bbea40b75d93 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:38.114028 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908243c4-b93a-46c2-b02d-bbea40b75d93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:38.124549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908243c4-b93a-46c2-b02d-bbea40b75d93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:38.125982 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908243c4-b93a-46c2-b02d-bbea40b75d93 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:38.143669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-908243c4-b93a-46c2-b02d-bbea40b75d93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:38.143669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:38.143669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:38.143669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:38.143669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:38.143669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:38.143669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:38.143669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:38.143669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:38.143669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:38.143669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:38.143669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:38.143669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:55:38.143669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:55:38.143669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:55:38.144712 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:55:38.144712 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:38.144712 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:38.144712 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:38.144712 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:38.144712 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:38.144712 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:38.144712 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:38.144712 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:55:38.144712 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:38.144712 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:38.144712 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:38.144712 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:38.144712 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:38.144712 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:38.144712 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:38.144712 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:38.145776 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:55:38.145776 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:55:38.145776 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:38.145776 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:55:38.145776 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 454/890] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:55:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:38.150462 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0ee38-69c6-4ac7-8016-cbd9812b23f8 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:38.243069 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0ee38-69c6-4ac7-8016-cbd9812b23f8 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:38.274872 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0da9e-9973-44f0-b0fd-572a6a566df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:38.275510 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0da9e-9973-44f0-b0fd-572a6a566df3 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:38.275807 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0da9e-9973-44f0-b0fd-572a6a566df3 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:38.276076 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0da9e-9973-44f0-b0fd-572a6a566df3 None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:38.276775 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0da9e-9973-44f0-b0fd-572a6a566df3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:38.277076 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0da9e-9973-44f0-b0fd-572a6a566df3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:38.278419 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0da9e-9973-44f0-b0fd-572a6a566df3 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:38.289449 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 437/891] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:38.294966 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908243c4-b93a-46c2-b02d-bbea40b75d93 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:38.387247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908243c4-b93a-46c2-b02d-bbea40b75d93 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:38.422237 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253592f-fca7-412d-aa7f-8e7172739df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:38.423024 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253592f-fca7-412d-aa7f-8e7172739df8 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:38.423301 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253592f-fca7-412d-aa7f-8e7172739df8 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:38.423569 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253592f-fca7-412d-aa7f-8e7172739df8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:38.429960 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253592f-fca7-412d-aa7f-8e7172739df8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:38.431399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253592f-fca7-412d-aa7f-8e7172739df8 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:38.445012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-3253592f-fca7-412d-aa7f-8e7172739df8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:55:38.445012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:38.445012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:38.445012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:38.445012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:38.445012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:38.445012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:38.445012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:38.445012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:38.445012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:38.445012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:38.445012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:38.445012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:55:38.445012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:55:38.445012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:55:38.446014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:55:38.446014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:38.446014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:38.446014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:38.446014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:38.446014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:38.446014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:38.446014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:38.446014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:55:38.446014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:38.446014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:38.446014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:38.446014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:38.446014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:38.446014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:38.446014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:38.446014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:38.447062 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:55:38.447062 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:55:38.447062 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:55:38.447062 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:55:38.447062 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:55:38.447062 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:55:38.447062 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:55:38.447062 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:55:38.447062 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 455/892] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:55:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:38.451889 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0da9e-9973-44f0-b0fd-572a6a566df3 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:38.545145 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0da9e-9973-44f0-b0fd-572a6a566df3 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:38.580210 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cb42d-e663-4d25-963b-0b037019b51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:38.580979 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cb42d-e663-4d25-963b-0b037019b51f None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:38.581267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cb42d-e663-4d25-963b-0b037019b51f None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:38.581648 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cb42d-e663-4d25-963b-0b037019b51f None admin] PATH_INFO: `/v3/projects` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:38.582616 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cb42d-e663-4d25-963b-0b037019b51f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:38.582967 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cb42d-e663-4d25-963b-0b037019b51f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:38.585231 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cb42d-e663-4d25-963b-0b037019b51f None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:38.598507 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 438/893] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:55:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:38.605314 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253592f-fca7-412d-aa7f-8e7172739df8 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:38.699587 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253592f-fca7-412d-aa7f-8e7172739df8 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:38.739023 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a27e0-6793-480a-8380-6b9f164fecc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:38.739947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a27e0-6793-480a-8380-6b9f164fecc8 None admin] REQUEST_METHOD: `PUT` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:38.740230 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a27e0-6793-480a-8380-6b9f164fecc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:38.740508 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a27e0-6793-480a-8380-6b9f164fecc8 None admin] PATH_INFO: `/v3/projects/d2ccefb3ecb0493bb0240a3853bfa5ff/users/8c64a6e5ef494d00817bb47cd6fd2bc4/roles/fbd6364b42a641f695c0b265a789057a` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:38.742441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a27e0-6793-480a-8380-6b9f164fecc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2ccefb3ecb0493bb0240a3853bfa5ff, user_id=8c64a6e5ef494d00817bb47cd6fd2bc4, role_id=fbd6364b42a641f695c0b265a789057a)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:38.743924 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a27e0-6793-480a-8380-6b9f164fecc8 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:38.756120 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 456/894] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 12 16:55:38 2022] PUT /identity/v3/projects/d2ccefb3ecb0493bb0240a3853bfa5ff/users/8c64a6e5ef494d00817bb47cd6fd2bc4/roles/fbd6364b42a641f695c0b265a789057a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 16:55:40.977397 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ddf43-7d01-46a2-8f1d-c4902c73e72f None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:40.977899 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ddf43-7d01-46a2-8f1d-c4902c73e72f None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:40.977990 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ddf43-7d01-46a2-8f1d-c4902c73e72f None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:40.979286 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 439/895] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:55:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:55:40.984527 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc63762-a205-499b-a54a-e377454f1145 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:40.984962 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc63762-a205-499b-a54a-e377454f1145 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:40.985078 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc63762-a205-499b-a54a-e377454f1145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:41.001670 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-dbc63762-a205-499b-a54a-e377454f1145 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:55:41.002820 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-dbc63762-a205-499b-a54a-e377454f1145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:55:41.063743 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 457/896] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:55:40 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 16:55:41.087381 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ddf43-7d01-46a2-8f1d-c4902c73e72f None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:41.182608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ddf43-7d01-46a2-8f1d-c4902c73e72f None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:41.213454 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c489d1-1afc-4d18-ae7a-f234e56e1919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:41.214222 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c489d1-1afc-4d18-ae7a-f234e56e1919 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:41.214501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c489d1-1afc-4d18-ae7a-f234e56e1919 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:41.214773 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c489d1-1afc-4d18-ae7a-f234e56e1919 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:41.224575 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c489d1-1afc-4d18-ae7a-f234e56e1919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 16:55:41.232613 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-c2c489d1-1afc-4d18-ae7a-f234e56e1919 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:55:41.232613 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:41.232613 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:41.232613 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:41.232613 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:41.232613 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:41.232613 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:41.232613 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:41.232613 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:41.232613 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:41.232613 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:41.232613 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:41.232613 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 16:55:41.232613 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 16:55:41.232613 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 16:55:41.232613 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 16:55:41.233672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 16:55:41.233672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 16:55:41.233672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 16:55:41.233672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 16:55:41.233672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:41.233672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:41.233672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:41.233672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:41.233672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:41.233672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:41.233672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:41.233672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:55:41.233672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:41.233672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:41.233672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:41.233672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:41.234690 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:41.234690 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:41.234690 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:41.234690 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:41.234690 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 16:55:41.234690 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 16:55:41.234690 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 16:55:41.234690 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 16:55:41.234690 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 16:55:41.234690 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 16:55:41.234690 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 16:55:41.234690 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:41.234690 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 440/897] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 12 16:55:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:41.239557 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc63762-a205-499b-a54a-e377454f1145 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:41.329763 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc63762-a205-499b-a54a-e377454f1145 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:41.361660 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a49a26-d695-4a46-a782-a920135f5d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:41.362308 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a49a26-d695-4a46-a782-a920135f5d32 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:41.362584 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a49a26-d695-4a46-a782-a920135f5d32 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:41.362852 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a49a26-d695-4a46-a782-a920135f5d32 None admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:41.363581 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a49a26-d695-4a46-a782-a920135f5d32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:41.363911 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a49a26-d695-4a46-a782-a920135f5d32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:41.365263 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a49a26-d695-4a46-a782-a920135f5d32 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:41.372790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 458/898] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 12 16:55:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:41.378346 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c489d1-1afc-4d18-ae7a-f234e56e1919 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:41.479776 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c489d1-1afc-4d18-ae7a-f234e56e1919 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:41.510762 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df3427-95a4-435c-a9c2-b80b918e6339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:41.511537 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df3427-95a4-435c-a9c2-b80b918e6339 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:41.511852 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df3427-95a4-435c-a9c2-b80b918e6339 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:41.512141 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df3427-95a4-435c-a9c2-b80b918e6339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:41.522262 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df3427-95a4-435c-a9c2-b80b918e6339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:41.524231 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df3427-95a4-435c-a9c2-b80b918e6339 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:41.541501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-c7df3427-95a4-435c-a9c2-b80b918e6339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:41.541501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:41.541501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:41.541501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:41.541501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:41.541501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:41.541501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:41.541501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:41.541501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:41.541501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:41.541501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:41.541501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:41.541501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:55:41.541501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:55:41.541501 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:55:41.542601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:55:41.542601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:41.542601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:41.542601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:41.542601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:41.542601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:41.542601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:41.542601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:41.542601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:55:41.542601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:41.542601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:41.542601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:41.542601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:41.542601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:41.542601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:41.542601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:41.542601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:41.543797 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:55:41.543797 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:55:41.543797 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:41.543797 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:41.543797 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 441/899] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:41.548731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a49a26-d695-4a46-a782-a920135f5d32 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:41.657126 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a49a26-d695-4a46-a782-a920135f5d32 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:41.690567 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded2d69-35db-4261-ac8d-680347ad9ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:41.691222 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded2d69-35db-4261-ac8d-680347ad9ca6 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:41.691503 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded2d69-35db-4261-ac8d-680347ad9ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:41.691818 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded2d69-35db-4261-ac8d-680347ad9ca6 None admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:41.692538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded2d69-35db-4261-ac8d-680347ad9ca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:41.692845 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded2d69-35db-4261-ac8d-680347ad9ca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:41.694786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded2d69-35db-4261-ac8d-680347ad9ca6 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:41.707904 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 459/900] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:41.714274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df3427-95a4-435c-a9c2-b80b918e6339 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:41.833781 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df3427-95a4-435c-a9c2-b80b918e6339 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:41.869719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b0632-e869-461d-b7cb-31c1774e2cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:41.871053 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b0632-e869-461d-b7cb-31c1774e2cc7 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:41.871548 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b0632-e869-461d-b7cb-31c1774e2cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:41.872032 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b0632-e869-461d-b7cb-31c1774e2cc7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:41.880380 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b0632-e869-461d-b7cb-31c1774e2cc7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:41.881899 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b0632-e869-461d-b7cb-31c1774e2cc7 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:41.899118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-da6b0632-e869-461d-b7cb-31c1774e2cc7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 16:55:41.899118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:41.899118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:41.899118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:41.899118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:41.899118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:41.899118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:41.899118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:41.899118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:41.899118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:41.899118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:41.899118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:41.899118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 16:55:41.899118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 16:55:41.899118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 16:55:41.899118 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 16:55:41.900259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:41.900259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:41.900259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 16:55:41.900259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:55:41.900259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 16:55:41.900259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 16:55:41.900259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:41.900259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:41.900259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:41.900259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:41.900259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:41.900259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:55:41.900259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:41.900259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:41.900259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:41.900259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:41.900259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:41.900259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:41.901597 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:41.901597 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:41.901597 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 16:55:41.901597 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 16:55:41.901597 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 16:55:41.901597 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 16:55:41.901597 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 16:55:41.901597 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 16:55:41.901597 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 16:55:41.901597 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:41.901597 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 442/901] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:55:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:41.906110 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded2d69-35db-4261-ac8d-680347ad9ca6 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:42.009074 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded2d69-35db-4261-ac8d-680347ad9ca6 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:42.041499 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34692645-7adc-4bf6-a09d-1b7900da85bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:42.042165 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34692645-7adc-4bf6-a09d-1b7900da85bc None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:42.042445 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34692645-7adc-4bf6-a09d-1b7900da85bc None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:42.042718 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34692645-7adc-4bf6-a09d-1b7900da85bc None admin] PATH_INFO: `/v3/users` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:42.043539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34692645-7adc-4bf6-a09d-1b7900da85bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:42.043881 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34692645-7adc-4bf6-a09d-1b7900da85bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:42.045319 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34692645-7adc-4bf6-a09d-1b7900da85bc None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:42.062610 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 460/902] 10.222.0.64 () {56 vars in 1143 bytes} [Thu May 12 16:55:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:42.068421 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b0632-e869-461d-b7cb-31c1774e2cc7 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:42.170566 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b0632-e869-461d-b7cb-31c1774e2cc7 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:42.203196 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b076a6-9277-43ef-997a-9627e71de566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:42.203861 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b076a6-9277-43ef-997a-9627e71de566 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:42.204143 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b076a6-9277-43ef-997a-9627e71de566 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:42.204416 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b076a6-9277-43ef-997a-9627e71de566 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:42.267726 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b076a6-9277-43ef-997a-9627e71de566 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:42.269163 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b076a6-9277-43ef-997a-9627e71de566 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:42.360109 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 443/903] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 12 16:55:42 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 16:55:42.366026 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34692645-7adc-4bf6-a09d-1b7900da85bc None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:42.463942 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34692645-7adc-4bf6-a09d-1b7900da85bc None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:42.496580 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653bd60-f68e-4b14-8fce-ba6daf88bfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:42.497364 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653bd60-f68e-4b14-8fce-ba6daf88bfd6 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:42.497645 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653bd60-f68e-4b14-8fce-ba6daf88bfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:42.497916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653bd60-f68e-4b14-8fce-ba6daf88bfd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:42.507280 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653bd60-f68e-4b14-8fce-ba6daf88bfd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:42.508933 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653bd60-f68e-4b14-8fce-ba6daf88bfd6 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:42.525661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-d653bd60-f68e-4b14-8fce-ba6daf88bfd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:42.525661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:42.525661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:42.525661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:42.525661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:42.525661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:42.525661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:42.525661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:42.525661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:42.525661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:42.525661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:42.525661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:42.525661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 16:55:42.525661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 16:55:42.525661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 16:55:42.526511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 16:55:42.526511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:42.526511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:42.526511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:42.526511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:42.526511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:42.526511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:42.526511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:42.526511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:55:42.526511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:42.526511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:42.526511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:42.526511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:42.526511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:42.526511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:42.526511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:42.526511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:42.527386 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 16:55:42.527386 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 16:55:42.527386 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 16:55:42.527386 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:55:42.527386 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 461/904] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:55:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:42.532754 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b076a6-9277-43ef-997a-9627e71de566 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:42.630604 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b076a6-9277-43ef-997a-9627e71de566 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:42.662030 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513435d4-fd55-405b-a583-f760cf0e0178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:42.662675 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513435d4-fd55-405b-a583-f760cf0e0178 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:42.662977 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513435d4-fd55-405b-a583-f760cf0e0178 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:42.663267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513435d4-fd55-405b-a583-f760cf0e0178 None admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:42.664542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513435d4-fd55-405b-a583-f760cf0e0178 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:42.664856 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513435d4-fd55-405b-a583-f760cf0e0178 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:42.666215 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513435d4-fd55-405b-a583-f760cf0e0178 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:42.677014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 444/905] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 12 16:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:42.683300 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653bd60-f68e-4b14-8fce-ba6daf88bfd6 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:42.776108 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653bd60-f68e-4b14-8fce-ba6daf88bfd6 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:42.807968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f423e96-b830-45bf-93e9-f31c47b533ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:42.808740 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f423e96-b830-45bf-93e9-f31c47b533ff None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:42.809019 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f423e96-b830-45bf-93e9-f31c47b533ff None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:42.809290 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f423e96-b830-45bf-93e9-f31c47b533ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:42.815557 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f423e96-b830-45bf-93e9-f31c47b533ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:42.817058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f423e96-b830-45bf-93e9-f31c47b533ff None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:42.830380 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application [None req-9f423e96-b830-45bf-93e9-f31c47b533ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:55:42.830380 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:42.830380 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:42.830380 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:42.830380 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:42.830380 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:42.830380 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:42.830380 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:42.830380 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:42.830380 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:42.830380 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:42.830380 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:42.830380 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 16:55:42.830380 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 16:55:42.830380 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 16:55:42.831558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 16:55:42.831558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:42.831558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:42.831558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:42.831558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:42.831558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:42.831558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:42.831558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:42.831558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application with Lock( May 12 16:55:42.831558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:42.831558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:42.831558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:42.831558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:42.831558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:42.831558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:42.831558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:42.831558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:42.832515 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 16:55:42.832515 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 16:55:42.832515 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 16:55:42.832515 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 16:55:42.832515 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 16:55:42.832515 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 16:55:42.832515 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 16:55:42.832515 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: ERROR keystone.server.flask.application May 12 16:55:42.832515 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 462/906] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 12 16:55:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:42.837928 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513435d4-fd55-405b-a583-f760cf0e0178 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:42.930936 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513435d4-fd55-405b-a583-f760cf0e0178 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:42.961980 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95214a0b-7b53-4f1a-b126-5f3e8c9e4996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:42.962621 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95214a0b-7b53-4f1a-b126-5f3e8c9e4996 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:42.962897 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95214a0b-7b53-4f1a-b126-5f3e8c9e4996 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:42.963164 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95214a0b-7b53-4f1a-b126-5f3e8c9e4996 None admin] PATH_INFO: `/v3/projects` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:42.963961 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95214a0b-7b53-4f1a-b126-5f3e8c9e4996 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:42.964263 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95214a0b-7b53-4f1a-b126-5f3e8c9e4996 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:42.965679 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95214a0b-7b53-4f1a-b126-5f3e8c9e4996 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:42.977749 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 445/907] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 12 16:55:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:55:42.983812 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f423e96-b830-45bf-93e9-f31c47b533ff None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:43.079498 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f423e96-b830-45bf-93e9-f31c47b533ff None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:43.112026 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795d63e-4ef3-465f-bf3c-8c0199fac108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:43.112670 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795d63e-4ef3-465f-bf3c-8c0199fac108 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:43.112953 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795d63e-4ef3-465f-bf3c-8c0199fac108 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:43.113230 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795d63e-4ef3-465f-bf3c-8c0199fac108 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:43.114054 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795d63e-4ef3-465f-bf3c-8c0199fac108 None admin] RBAC: Adding query filter params (role.id=fbd6364b42a641f695c0b265a789057a, scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff, user.id=8c64a6e5ef494d00817bb47cd6fd2bc4) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:43.114370 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795d63e-4ef3-465f-bf3c-8c0199fac108 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:43.115829 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795d63e-4ef3-465f-bf3c-8c0199fac108 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:43.121490 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 463/908] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 12 16:55:42 2022] GET /identity/v3/role_assignments?user.id=8c64a6e5ef494d00817bb47cd6fd2bc4&scope.project.id=d2ccefb3ecb0493bb0240a3853bfa5ff&role.id=fbd6364b42a641f695c0b265a789057a => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:45.412546 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7968b-fe2f-4055-80dd-e2878dab1e0a None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:45.413059 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7968b-fe2f-4055-80dd-e2878dab1e0a None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:45.413175 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7968b-fe2f-4055-80dd-e2878dab1e0a None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:45.414976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 446/909] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:55:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:55:45.420110 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162984b7-7a70-49c8-a0a3-2fb42905a278 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:45.420476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162984b7-7a70-49c8-a0a3-2fb42905a278 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:45.420673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162984b7-7a70-49c8-a0a3-2fb42905a278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:45.438603 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-162984b7-7a70-49c8-a0a3-2fb42905a278 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:55:45.440490 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-162984b7-7a70-49c8-a0a3-2fb42905a278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:55:45.504034 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 464/910] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:55:45 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:55:45.528170 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7968b-fe2f-4055-80dd-e2878dab1e0a None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:45.634445 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7968b-fe2f-4055-80dd-e2878dab1e0a None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:45.667702 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf17d4-fcb0-4103-b237-c6d911cae821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:45.668445 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf17d4-fcb0-4103-b237-c6d911cae821 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:45.668727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf17d4-fcb0-4103-b237-c6d911cae821 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:45.669003 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf17d4-fcb0-4103-b237-c6d911cae821 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:45.669649 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf17d4-fcb0-4103-b237-c6d911cae821 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:45.671019 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf17d4-fcb0-4103-b237-c6d911cae821 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:45.682545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-4daf17d4-fcb0-4103-b237-c6d911cae821 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 16:55:45.682545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:45.682545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:55:45.682545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:55:45.682545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:55:45.682545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:55:45.682545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:55:45.682545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:55:45.682545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 16:55:45.682545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:45.682545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:55:45.682545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:45.682545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:45.682545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:45.682545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:45.682545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:45.682545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:45.683716 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:45.683716 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:45.683716 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:45.683716 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:45.683716 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:45.683716 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:45.683716 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:55:45.683716 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:55:45.683716 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:55:45.683716 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:55:45.683716 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:45.683716 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:45.683716 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:45.683716 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:45.683716 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:45.683716 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:45.684731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:45.684731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:55:45.684731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:45.684731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:45.684731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:45.684731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:45.684731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:45.684731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:45.684731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:45.684731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:45.684731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:55:45.684731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:55:45.684731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 16:55:45.684731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:45.684731 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 447/911] 10.222.0.64 () {56 vars in 1117 bytes} [Thu May 12 16:55:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 16:55:45.689857 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162984b7-7a70-49c8-a0a3-2fb42905a278 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:45.783616 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162984b7-7a70-49c8-a0a3-2fb42905a278 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:45.815020 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049400be-be20-4cfc-8951-147ddac02196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:45.815688 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049400be-be20-4cfc-8951-147ddac02196 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:45.815974 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049400be-be20-4cfc-8951-147ddac02196 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:45.816247 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049400be-be20-4cfc-8951-147ddac02196 None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:45.816940 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049400be-be20-4cfc-8951-147ddac02196 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:45.817251 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049400be-be20-4cfc-8951-147ddac02196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:45.818617 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049400be-be20-4cfc-8951-147ddac02196 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:45.823659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 465/912] 10.222.0.64 () {56 vars in 1116 bytes} [Thu May 12 16:55:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:45.829131 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf17d4-fcb0-4103-b237-c6d911cae821 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:45.926100 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf17d4-fcb0-4103-b237-c6d911cae821 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:45.958507 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ce3d7-3c53-467a-9aa6-e4fab8ffdfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:45.959156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ce3d7-3c53-467a-9aa6-e4fab8ffdfe8 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:45.959436 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ce3d7-3c53-467a-9aa6-e4fab8ffdfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:45.959740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ce3d7-3c53-467a-9aa6-e4fab8ffdfe8 None admin] PATH_INFO: `/v3/services` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:45.960441 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ce3d7-3c53-467a-9aa6-e4fab8ffdfe8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:45.960748 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ce3d7-3c53-467a-9aa6-e4fab8ffdfe8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:45.962101 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ce3d7-3c53-467a-9aa6-e4fab8ffdfe8 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:45.966350 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 448/913] 10.222.0.64 () {56 vars in 1116 bytes} [Thu May 12 16:55:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 16:55:48.212051 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb791a-3263-4599-b9f3-50576616d334 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:48.212566 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb791a-3263-4599-b9f3-50576616d334 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:48.212566 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb791a-3263-4599-b9f3-50576616d334 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:48.213890 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 466/914] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:55:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:55:48.219056 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf3b44-467a-4998-92b5-5fdb2d437f8a None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:48.219417 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf3b44-467a-4998-92b5-5fdb2d437f8a None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:48.219610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf3b44-467a-4998-92b5-5fdb2d437f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:48.236777 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-8eaf3b44-467a-4998-92b5-5fdb2d437f8a None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:55:48.237955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-8eaf3b44-467a-4998-92b5-5fdb2d437f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:55:48.299554 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 449/915] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:55:48 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:55:48.322629 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb791a-3263-4599-b9f3-50576616d334 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:48.417955 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb791a-3263-4599-b9f3-50576616d334 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:48.449371 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139db25d-620a-42a6-985a-950b3d3a251b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:48.450016 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139db25d-620a-42a6-985a-950b3d3a251b None admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:48.450297 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139db25d-620a-42a6-985a-950b3d3a251b None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:48.450570 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139db25d-620a-42a6-985a-950b3d3a251b None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:48.451291 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139db25d-620a-42a6-985a-950b3d3a251b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:48.452689 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139db25d-620a-42a6-985a-950b3d3a251b None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:48.466022 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 467/916] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 12 16:55:48 2022] POST /identity/v3/services => generated 246 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 16:55:50.754195 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e551f-095f-454c-b504-2ca04b24a68f None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:50.754718 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e551f-095f-454c-b504-2ca04b24a68f None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:50.754718 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e551f-095f-454c-b504-2ca04b24a68f None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:50.756154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 450/917] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:55:50.761202 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8de2f-e5c5-4095-ab2d-9750f5b9941c None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:50.761589 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8de2f-e5c5-4095-ab2d-9750f5b9941c None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:50.761761 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8de2f-e5c5-4095-ab2d-9750f5b9941c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:50.777817 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-0fa8de2f-e5c5-4095-ab2d-9750f5b9941c None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:55:50.778979 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-0fa8de2f-e5c5-4095-ab2d-9750f5b9941c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:55:50.845687 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 468/918] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:55:50 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:55:50.871199 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e551f-095f-454c-b504-2ca04b24a68f None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:50.970596 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e551f-095f-454c-b504-2ca04b24a68f None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:51.002747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f4a81-878c-48bb-8203-1d8952b5a5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:51.003530 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f4a81-878c-48bb-8203-1d8952b5a5cf None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:51.003838 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f4a81-878c-48bb-8203-1d8952b5a5cf None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:51.004110 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f4a81-878c-48bb-8203-1d8952b5a5cf None admin] PATH_INFO: `/v3/services/placement` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:51.004801 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f4a81-878c-48bb-8203-1d8952b5a5cf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:51.006109 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f4a81-878c-48bb-8203-1d8952b5a5cf None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:51.017468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-9f2f4a81-878c-48bb-8203-1d8952b5a5cf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 16:55:51.017468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:51.017468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:55:51.017468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:55:51.017468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:55:51.017468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:55:51.017468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:55:51.017468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:55:51.017468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 16:55:51.017468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:51.017468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:55:51.017468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:51.017468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:51.017468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:51.017468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:51.017468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:51.017468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:51.018605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:51.018605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:51.018605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:51.018605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:51.018605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:51.018605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:51.018605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:55:51.018605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:55:51.018605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:55:51.018605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:55:51.018605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:51.018605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:51.018605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:51.018605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:51.018605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:51.018605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:51.019628 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:51.019628 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:55:51.019628 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:51.019628 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:51.019628 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:51.019628 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:51.019628 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:51.019628 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:51.019628 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:51.019628 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:51.019628 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:55:51.019628 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:55:51.019628 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 16:55:51.019628 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:51.019628 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 451/919] 10.222.0.64 () {56 vars in 1117 bytes} [Thu May 12 16:55:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:51.025317 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8de2f-e5c5-4095-ab2d-9750f5b9941c None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:51.118470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8de2f-e5c5-4095-ab2d-9750f5b9941c None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:51.160074 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b7a39-6e53-412c-8014-601ac666c2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:51.161132 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b7a39-6e53-412c-8014-601ac666c2f0 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:51.161616 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b7a39-6e53-412c-8014-601ac666c2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:51.162088 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b7a39-6e53-412c-8014-601ac666c2f0 None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:51.162816 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b7a39-6e53-412c-8014-601ac666c2f0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:51.163126 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b7a39-6e53-412c-8014-601ac666c2f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:51.165100 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b7a39-6e53-412c-8014-601ac666c2f0 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:51.170085 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 469/920] 10.222.0.64 () {56 vars in 1116 bytes} [Thu May 12 16:55:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:51.176142 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f4a81-878c-48bb-8203-1d8952b5a5cf None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:51.273416 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f4a81-878c-48bb-8203-1d8952b5a5cf None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:51.304533 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3f282-76db-4492-88fb-abcfe7b9a688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:51.305171 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3f282-76db-4492-88fb-abcfe7b9a688 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:51.305451 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3f282-76db-4492-88fb-abcfe7b9a688 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:51.305725 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3f282-76db-4492-88fb-abcfe7b9a688 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:51.306496 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3f282-76db-4492-88fb-abcfe7b9a688 None admin] RBAC: Adding query filter params (interface=public, service_id=f34bd10b1f574aa2b01045d281f735ab, region_id=RegionOne) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:51.306805 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3f282-76db-4492-88fb-abcfe7b9a688 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:51.308189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3f282-76db-4492-88fb-abcfe7b9a688 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:51.312965 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 452/921] 10.222.0.64 () {56 vars in 1251 bytes} [Thu May 12 16:55:51 2022] GET /identity/v3/endpoints?service_id=f34bd10b1f574aa2b01045d281f735ab&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:51.318438 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b7a39-6e53-412c-8014-601ac666c2f0 None admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:51.411405 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b7a39-6e53-412c-8014-601ac666c2f0 None admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:51.443033 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a941543-d994-408e-8d7e-ee98d0fef403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:51.443691 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a941543-d994-408e-8d7e-ee98d0fef403 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:51.443974 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a941543-d994-408e-8d7e-ee98d0fef403 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:51.444245 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a941543-d994-408e-8d7e-ee98d0fef403 None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:51.445433 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a941543-d994-408e-8d7e-ee98d0fef403 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:51.446786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a941543-d994-408e-8d7e-ee98d0fef403 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:51.453179 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 470/922] 10.222.0.64 () {56 vars in 1087 bytes} [Thu May 12 16:55:51 2022] GET /identity/v3/services => generated 1962 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 16:55:53.704379 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b089e-2194-4c31-9a8f-3c8caaa6bfcd None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:53.704905 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b089e-2194-4c31-9a8f-3c8caaa6bfcd None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:53.704905 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b089e-2194-4c31-9a8f-3c8caaa6bfcd None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:53.706287 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 453/923] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:55:53.711363 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a474564-9fe1-4be1-8c92-fcb3fb0c7117 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:53.711789 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a474564-9fe1-4be1-8c92-fcb3fb0c7117 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:53.711931 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a474564-9fe1-4be1-8c92-fcb3fb0c7117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:53.728600 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-0a474564-9fe1-4be1-8c92-fcb3fb0c7117 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:55:53.729760 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-0a474564-9fe1-4be1-8c92-fcb3fb0c7117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:55:53.792591 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 471/924] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:55:53 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 16:55:53.818267 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b089e-2194-4c31-9a8f-3c8caaa6bfcd None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:53.923602 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b089e-2194-4c31-9a8f-3c8caaa6bfcd None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:53.956127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4aaa04-7ebb-497a-abf0-6228a5367c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:53.956856 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4aaa04-7ebb-497a-abf0-6228a5367c34 None admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:53.957136 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4aaa04-7ebb-497a-abf0-6228a5367c34 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:53.957417 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4aaa04-7ebb-497a-abf0-6228a5367c34 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:53.958067 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4aaa04-7ebb-497a-abf0-6228a5367c34 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:53.959426 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4aaa04-7ebb-497a-abf0-6228a5367c34 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:53.971413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application [None req-9d4aaa04-7ebb-497a-abf0-6228a5367c34 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 16:55:53.971413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:53.971413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 16:55:53.971413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 16:55:53.971413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 16:55:53.971413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 16:55:53.971413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 16:55:53.971413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:55:53.971413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 16:55:53.971413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:53.971413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 16:55:53.971413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:53.971413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 16:55:53.971413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 16:55:53.971413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 16:55:53.971413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 16:55:53.971413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 16:55:53.972569 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 16:55:53.972569 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 16:55:53.972569 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 16:55:53.972569 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 16:55:53.972569 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 16:55:53.972569 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 16:55:53.972569 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 16:55:53.972569 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 16:55:53.972569 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 16:55:53.972569 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 16:55:53.972569 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 16:55:53.972569 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 16:55:53.972569 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 16:55:53.972569 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 16:55:53.972569 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 16:55:53.972569 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.get_or_create( May 12 16:55:53.973856 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 16:55:53.973856 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application with Lock( May 12 16:55:53.973856 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 16:55:53.973856 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self._enter() May 12 16:55:53.973856 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 16:55:53.973856 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 16:55:53.973856 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 16:55:53.973856 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application return self.creator() May 12 16:55:53.973856 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 16:55:53.973856 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application created_value = creator( May 12 16:55:53.973856 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 16:55:53.973856 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 16:55:53.973856 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 16:55:53.973856 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: ERROR keystone.server.flask.application May 12 16:55:53.973856 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 454/925] 10.222.0.64 () {56 vars in 1117 bytes} [Thu May 12 16:55:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 16:55:53.979460 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a474564-9fe1-4be1-8c92-fcb3fb0c7117 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:54.070126 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a474564-9fe1-4be1-8c92-fcb3fb0c7117 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:54.102094 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84bbb0-c878-4d3f-850c-f359815d2a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:54.102746 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84bbb0-c878-4d3f-850c-f359815d2a61 None admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:54.103026 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84bbb0-c878-4d3f-850c-f359815d2a61 None admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:54.103300 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84bbb0-c878-4d3f-850c-f359815d2a61 None admin] PATH_INFO: `/v3/services` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:54.104031 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84bbb0-c878-4d3f-850c-f359815d2a61 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 16:55:54.104336 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84bbb0-c878-4d3f-850c-f359815d2a61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:54.105705 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84bbb0-c878-4d3f-850c-f359815d2a61 None admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:54.110514 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 472/926] 10.222.0.64 () {56 vars in 1116 bytes} [Thu May 12 16:55:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 16:55:54.116175 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4aaa04-7ebb-497a-abf0-6228a5367c34 None admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:55:54.227422 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4aaa04-7ebb-497a-abf0-6228a5367c34 None admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:55:54.258097 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d2495-46ef-4f2a-937f-03d0fc14e113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:55:54.258743 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d2495-46ef-4f2a-937f-03d0fc14e113 None admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:55:54.259018 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d2495-46ef-4f2a-937f-03d0fc14e113 None admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:55:54.259288 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d2495-46ef-4f2a-937f-03d0fc14e113 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:55:54.260114 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d2495-46ef-4f2a-937f-03d0fc14e113 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:55:54.261467 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d2495-46ef-4f2a-937f-03d0fc14e113 None admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:55:54.279601 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 455/927] 10.222.0.64 () {60 vars in 1144 bytes} [Thu May 12 16:55:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 16:56:52.375059 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5d3ae-7736-432f-af67-df2ee4a49d2d None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:52.375535 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5d3ae-7736-432f-af67-df2ee4a49d2d None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:52.375663 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5d3ae-7736-432f-af67-df2ee4a49d2d None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:52.377263 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 473/928] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:56:52.383587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3660f-4dfe-4e25-983e-99e1e479145e None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:52.384379 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3660f-4dfe-4e25-983e-99e1e479145e None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:52.384799 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3660f-4dfe-4e25-983e-99e1e479145e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:52.404357 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-3fc3660f-4dfe-4e25-983e-99e1e479145e None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:56:52.405718 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-3fc3660f-4dfe-4e25-983e-99e1e479145e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:56:52.532352 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 456/929] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:56:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:56:52.586860 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a99d0-7a54-4446-b609-95f0810bad75 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:52.587567 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a99d0-7a54-4446-b609-95f0810bad75 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:52.588829 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a99d0-7a54-4446-b609-95f0810bad75 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:52.591626 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 474/930] 10.222.0.64 () {54 vars in 964 bytes} [Thu May 12 16:56:52 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:56:52.597532 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad78d5-3856-48b4-a6bc-8e385359c261 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:52.597888 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad78d5-3856-48b4-a6bc-8e385359c261 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:52.598217 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad78d5-3856-48b4-a6bc-8e385359c261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:52.672814 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-dfad78d5-3856-48b4-a6bc-8e385359c261 None None] MFA Rules not processed for user `b2cc0957b3e2402b8e6f47d46bfa02be`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:56:52.675297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-dfad78d5-3856-48b4-a6bc-8e385359c261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:56:52.756362 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 457/931] 10.222.0.64 () {58 vars in 1061 bytes} [Thu May 12 16:56:52 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:56:52.765998 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a99d0-7a54-4446-b609-95f0810bad75 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:56:52.777288 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a99d0-7a54-4446-b609-95f0810bad75 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:56:52.782234 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bdc11-7b61-41b7-a82d-1fac5eab8faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:56:52.782234 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bdc11-7b61-41b7-a82d-1fac5eab8faf service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:52.782650 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bdc11-7b61-41b7-a82d-1fac5eab8faf service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:52.782809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bdc11-7b61-41b7-a82d-1fac5eab8faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:52.801613 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bdc11-7b61-41b7-a82d-1fac5eab8faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:56:52.805371 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bdc11-7b61-41b7-a82d-1fac5eab8faf service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:56:52.820645 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 475/932] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:56:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:56:55.386672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e77c49-0472-46f8-a5b0-6b736c5c9745 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:55.387207 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e77c49-0472-46f8-a5b0-6b736c5c9745 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:55.387207 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e77c49-0472-46f8-a5b0-6b736c5c9745 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:55.388770 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 458/933] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:56:55.393641 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140fa50-0696-48ea-bda7-41d8401bfe0e None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:55.394019 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140fa50-0696-48ea-bda7-41d8401bfe0e None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:55.394189 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140fa50-0696-48ea-bda7-41d8401bfe0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:55.412219 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-6140fa50-0696-48ea-bda7-41d8401bfe0e None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:56:55.413415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-6140fa50-0696-48ea-bda7-41d8401bfe0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:56:55.421097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 476/934] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:56:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:56:55.459260 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e77c49-0472-46f8-a5b0-6b736c5c9745 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:56:55.470159 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e77c49-0472-46f8-a5b0-6b736c5c9745 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:56:55.473681 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e8601-31fd-4384-b87e-c5f2d8950507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:56:55.474705 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e8601-31fd-4384-b87e-c5f2d8950507 service neutron] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:55.474984 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e8601-31fd-4384-b87e-c5f2d8950507 service neutron] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:55.475307 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e8601-31fd-4384-b87e-c5f2d8950507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:55.484292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e8601-31fd-4384-b87e-c5f2d8950507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:56:55.485734 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e8601-31fd-4384-b87e-c5f2d8950507 service neutron] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:56:55.495693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 459/935] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:56:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:56:58.073469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a6819-59d3-4ffe-9409-d85d25f5cb77 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:58.074029 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a6819-59d3-4ffe-9409-d85d25f5cb77 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:58.074029 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a6819-59d3-4ffe-9409-d85d25f5cb77 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:58.075372 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 477/936] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:56:58.080681 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26115d-539f-49d9-8082-f10296b49873 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:58.081097 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26115d-539f-49d9-8082-f10296b49873 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:58.081422 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26115d-539f-49d9-8082-f10296b49873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:58.115622 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-7b26115d-539f-49d9-8082-f10296b49873 None None] MFA Rules not processed for user `3e0ac53f471746699df5c834e91784f1`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:56:58.117449 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-7b26115d-539f-49d9-8082-f10296b49873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:56:58.185056 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 460/937] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:56:58 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:56:58.224909 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a6819-59d3-4ffe-9409-d85d25f5cb77 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:56:58.235780 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a6819-59d3-4ffe-9409-d85d25f5cb77 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:56:58.239173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b0176-eb00-4140-b966-b8518400b609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:56:58.239849 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b0176-eb00-4140-b966-b8518400b609 service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:56:58.240138 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b0176-eb00-4140-b966-b8518400b609 service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:56:58.240412 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b0176-eb00-4140-b966-b8518400b609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:56:58.249673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b0176-eb00-4140-b966-b8518400b609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:56:58.251115 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b0176-eb00-4140-b966-b8518400b609 service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:56:58.260509 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 478/938] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:56:58 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:57:01.078454 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749d125-d22d-40e6-b631-7c33ced2070d None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:01.079009 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749d125-d22d-40e6-b631-7c33ced2070d None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:01.079009 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749d125-d22d-40e6-b631-7c33ced2070d None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:01.080389 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 461/939] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:01.086212 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbc0df-9ad0-4b1e-a6e1-3f8a6804fbc8 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:01.086630 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbc0df-9ad0-4b1e-a6e1-3f8a6804fbc8 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:01.086758 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbc0df-9ad0-4b1e-a6e1-3f8a6804fbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:01.104359 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-4cdbc0df-9ad0-4b1e-a6e1-3f8a6804fbc8 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:01.105553 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-4cdbc0df-9ad0-4b1e-a6e1-3f8a6804fbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:01.167896 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 479/940] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:57:01 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:57:01.206004 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749d125-d22d-40e6-b631-7c33ced2070d None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:57:01.216786 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749d125-d22d-40e6-b631-7c33ced2070d None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:57:01.220189 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ff304-8bfd-43e5-a293-ce5dca49d063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:57:01.220816 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ff304-8bfd-43e5-a293-ce5dca49d063 service neutron] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:01.221126 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ff304-8bfd-43e5-a293-ce5dca49d063 service neutron] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:01.221400 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ff304-8bfd-43e5-a293-ce5dca49d063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:01.230167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ff304-8bfd-43e5-a293-ce5dca49d063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:57:01.231594 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ff304-8bfd-43e5-a293-ce5dca49d063 service neutron] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:57:01.240668 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 462/941] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:57:01 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:57:04.140579 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3b23e-6771-4293-8699-207e57f7d102 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:04.141146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3b23e-6771-4293-8699-207e57f7d102 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:04.141146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3b23e-6771-4293-8699-207e57f7d102 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:04.142519 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 480/942] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:04.147643 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c3738-c0f2-427a-9b59-1b586dae309e None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:04.148019 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c3738-c0f2-427a-9b59-1b586dae309e None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:04.148339 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c3738-c0f2-427a-9b59-1b586dae309e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:04.166280 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-0c0c3738-c0f2-427a-9b59-1b586dae309e None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:04.167401 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-0c0c3738-c0f2-427a-9b59-1b586dae309e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:04.175246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 463/943] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:57:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:57:04.211119 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3b23e-6771-4293-8699-207e57f7d102 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:57:04.221391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3b23e-6771-4293-8699-207e57f7d102 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:57:04.225613 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e1b1c-2800-4b13-a7da-d82335e484c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:57:04.226313 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e1b1c-2800-4b13-a7da-d82335e484c4 service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:04.226664 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e1b1c-2800-4b13-a7da-d82335e484c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:04.227003 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e1b1c-2800-4b13-a7da-d82335e484c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:04.235563 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e1b1c-2800-4b13-a7da-d82335e484c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:57:04.237019 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e1b1c-2800-4b13-a7da-d82335e484c4 service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:57:04.246612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 481/944] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:57:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:57:06.642502 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932904b-0a01-4ccf-82e0-f5fa09864a4a None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:06.643203 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932904b-0a01-4ccf-82e0-f5fa09864a4a None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:06.643203 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932904b-0a01-4ccf-82e0-f5fa09864a4a None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:06.644465 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 464/945] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:06.649773 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb551bb3-a9d1-48ca-8096-35e26ce3e2d3 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:06.650174 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb551bb3-a9d1-48ca-8096-35e26ce3e2d3 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:06.650344 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb551bb3-a9d1-48ca-8096-35e26ce3e2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:06.667922 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-bb551bb3-a9d1-48ca-8096-35e26ce3e2d3 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:06.669103 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-bb551bb3-a9d1-48ca-8096-35e26ce3e2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:06.676874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 482/946] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:57:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:57:06.713579 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932904b-0a01-4ccf-82e0-f5fa09864a4a None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:57:06.724269 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932904b-0a01-4ccf-82e0-f5fa09864a4a None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:57:06.728362 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04cb53-b052-468c-afb1-ffe923871500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:57:06.729006 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04cb53-b052-468c-afb1-ffe923871500 service neutron] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:06.729288 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04cb53-b052-468c-afb1-ffe923871500 service neutron] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:06.729563 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04cb53-b052-468c-afb1-ffe923871500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:06.738206 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04cb53-b052-468c-afb1-ffe923871500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:57:06.739692 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04cb53-b052-468c-afb1-ffe923871500 service neutron] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:57:06.749603 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 465/947] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:57:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:57:09.081612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7009f5-0822-498a-ae60-345116fc1b65 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:09.082202 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7009f5-0822-498a-ae60-345116fc1b65 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:09.082202 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7009f5-0822-498a-ae60-345116fc1b65 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:09.083520 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 483/948] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:09.088886 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53c92d-74f2-4c2c-aaea-69d9cf30b3ba None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:09.089306 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53c92d-74f2-4c2c-aaea-69d9cf30b3ba None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:09.089439 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53c92d-74f2-4c2c-aaea-69d9cf30b3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:09.106717 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-4d53c92d-74f2-4c2c-aaea-69d9cf30b3ba None None] MFA Rules not processed for user `3e0ac53f471746699df5c834e91784f1`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:09.107929 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-4d53c92d-74f2-4c2c-aaea-69d9cf30b3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:09.115384 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 466/949] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:57:09 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:57:09.153761 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7009f5-0822-498a-ae60-345116fc1b65 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:57:09.164019 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7009f5-0822-498a-ae60-345116fc1b65 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:57:09.167280 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d6989-174f-4848-bcb2-fbe39dd9b4be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:57:09.168020 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d6989-174f-4848-bcb2-fbe39dd9b4be service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:09.168298 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d6989-174f-4848-bcb2-fbe39dd9b4be service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:09.168569 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d6989-174f-4848-bcb2-fbe39dd9b4be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:09.177007 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d6989-174f-4848-bcb2-fbe39dd9b4be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:57:09.178942 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d6989-174f-4848-bcb2-fbe39dd9b4be service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:57:09.188050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 484/950] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:57:09 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:57:11.728345 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cf32f-d733-4f62-94e8-e1ba0aabbeb3 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:11.728840 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cf32f-d733-4f62-94e8-e1ba0aabbeb3 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:11.728946 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cf32f-d733-4f62-94e8-e1ba0aabbeb3 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:11.730462 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 467/951] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:11.735869 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c376d7-7606-4cbe-bb6b-59d16cf123d8 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:11.736246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c376d7-7606-4cbe-bb6b-59d16cf123d8 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:11.736426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c376d7-7606-4cbe-bb6b-59d16cf123d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:11.753539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-00c376d7-7606-4cbe-bb6b-59d16cf123d8 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:11.754780 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-00c376d7-7606-4cbe-bb6b-59d16cf123d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:11.762895 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 485/952] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:57:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:57:11.799433 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cf32f-d733-4f62-94e8-e1ba0aabbeb3 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:57:11.809903 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cf32f-d733-4f62-94e8-e1ba0aabbeb3 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:57:11.813344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe839c5-2ca8-4456-b614-5068f882cff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:57:11.813974 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe839c5-2ca8-4456-b614-5068f882cff3 service neutron] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:11.814258 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe839c5-2ca8-4456-b614-5068f882cff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:11.814532 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe839c5-2ca8-4456-b614-5068f882cff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:11.823800 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe839c5-2ca8-4456-b614-5068f882cff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:57:11.825230 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe839c5-2ca8-4456-b614-5068f882cff3 service neutron] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:57:11.835094 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 468/953] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:57:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:57:14.145415 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fe024-6823-4b74-8126-87ed59b578b4 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:14.145951 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fe024-6823-4b74-8126-87ed59b578b4 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:14.145951 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fe024-6823-4b74-8126-87ed59b578b4 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:14.147362 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 486/954] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:14.152574 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e435ff-068a-49e0-803c-eee078cffb4c None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:14.152968 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e435ff-068a-49e0-803c-eee078cffb4c None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:14.153125 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e435ff-068a-49e0-803c-eee078cffb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:14.172313 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-e0e435ff-068a-49e0-803c-eee078cffb4c None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:14.173419 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-e0e435ff-068a-49e0-803c-eee078cffb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:14.181610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 469/955] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:57:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:57:14.221885 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fe024-6823-4b74-8126-87ed59b578b4 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:57:14.235046 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fe024-6823-4b74-8126-87ed59b578b4 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:57:14.238759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8609f-55a6-474d-943d-ced0dc1726fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:57:14.239413 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8609f-55a6-474d-943d-ced0dc1726fd service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:14.239738 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8609f-55a6-474d-943d-ced0dc1726fd service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:14.240019 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8609f-55a6-474d-943d-ced0dc1726fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:14.250285 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8609f-55a6-474d-943d-ced0dc1726fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:57:14.251768 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8609f-55a6-474d-943d-ced0dc1726fd service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:57:14.261383 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 487/956] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:57:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:57:16.883863 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2892946-42b8-45b6-a970-cd0c1a4d8232 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:16.884410 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2892946-42b8-45b6-a970-cd0c1a4d8232 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:16.884410 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2892946-42b8-45b6-a970-cd0c1a4d8232 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:16.885751 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 470/957] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:16.890840 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651de8f2-b9e9-429d-a515-d12b8bbefc79 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:16.891277 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651de8f2-b9e9-429d-a515-d12b8bbefc79 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:16.891378 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651de8f2-b9e9-429d-a515-d12b8bbefc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:16.908483 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-651de8f2-b9e9-429d-a515-d12b8bbefc79 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:16.909710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-651de8f2-b9e9-429d-a515-d12b8bbefc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:16.918030 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 488/958] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:57:16 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:57:16.954128 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2892946-42b8-45b6-a970-cd0c1a4d8232 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:57:16.964456 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2892946-42b8-45b6-a970-cd0c1a4d8232 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:57:16.967873 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b88a7f-fef2-4cac-ad51-9e54507d9b49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:57:16.968529 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b88a7f-fef2-4cac-ad51-9e54507d9b49 service neutron] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:16.968809 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b88a7f-fef2-4cac-ad51-9e54507d9b49 service neutron] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:16.969081 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b88a7f-fef2-4cac-ad51-9e54507d9b49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:16.978385 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b88a7f-fef2-4cac-ad51-9e54507d9b49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:57:16.979968 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b88a7f-fef2-4cac-ad51-9e54507d9b49 service neutron] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:57:16.988985 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 471/959] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:57:16 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:57:21.183536 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10175c-a863-4908-980d-a3ca2ce92497 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:21.184095 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10175c-a863-4908-980d-a3ca2ce92497 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:21.184095 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10175c-a863-4908-980d-a3ca2ce92497 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:21.185453 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 489/960] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:21.190640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff864f-0e76-492e-bee6-6ce6ae09f076 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:21.191022 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff864f-0e76-492e-bee6-6ce6ae09f076 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:21.191311 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff864f-0e76-492e-bee6-6ce6ae09f076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:21.208963 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-aaff864f-0e76-492e-bee6-6ce6ae09f076 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:21.210158 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-aaff864f-0e76-492e-bee6-6ce6ae09f076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:21.218016 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 472/961] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:57:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:57:21.258916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10175c-a863-4908-980d-a3ca2ce92497 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:57:21.269355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10175c-a863-4908-980d-a3ca2ce92497 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:57:21.272855 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff3509-dbf4-43e1-b079-12f002f5f999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:57:21.273493 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff3509-dbf4-43e1-b079-12f002f5f999 service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:21.273778 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff3509-dbf4-43e1-b079-12f002f5f999 service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:21.274056 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff3509-dbf4-43e1-b079-12f002f5f999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:21.282727 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff3509-dbf4-43e1-b079-12f002f5f999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:57:21.284188 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff3509-dbf4-43e1-b079-12f002f5f999 service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:57:21.293517 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 490/962] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:57:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:57:24.237022 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de8c27-b795-4127-abff-c588f0a33d49 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:24.237516 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de8c27-b795-4127-abff-c588f0a33d49 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:24.237617 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de8c27-b795-4127-abff-c588f0a33d49 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:24.238920 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 473/963] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:24.244710 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcd310-7111-4766-acb0-507bc754b359 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:24.245129 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcd310-7111-4766-acb0-507bc754b359 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:24.245402 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcd310-7111-4766-acb0-507bc754b359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:24.263111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-f3dcd310-7111-4766-acb0-507bc754b359 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:24.264405 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-f3dcd310-7111-4766-acb0-507bc754b359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:24.272154 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 491/964] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:57:24 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:57:24.310065 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de8c27-b795-4127-abff-c588f0a33d49 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:57:24.320975 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de8c27-b795-4127-abff-c588f0a33d49 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:57:24.324786 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456c8a3-3c48-4ff0-9139-5a412e721bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:57:24.325408 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456c8a3-3c48-4ff0-9139-5a412e721bba service neutron] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:24.325689 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456c8a3-3c48-4ff0-9139-5a412e721bba service neutron] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:24.325955 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456c8a3-3c48-4ff0-9139-5a412e721bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:24.336084 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456c8a3-3c48-4ff0-9139-5a412e721bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:57:24.337719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456c8a3-3c48-4ff0-9139-5a412e721bba service neutron] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:57:24.347847 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 474/965] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:57:24 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:57:28.602149 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ea47c-1d20-49d9-8276-2fd6d0820840 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:28.602646 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ea47c-1d20-49d9-8276-2fd6d0820840 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:28.602733 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ea47c-1d20-49d9-8276-2fd6d0820840 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:28.604116 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 492/966] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:28.609243 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def114e3-898c-40b1-a264-cefda6cb4110 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:28.609641 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def114e3-898c-40b1-a264-cefda6cb4110 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:28.609790 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def114e3-898c-40b1-a264-cefda6cb4110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:28.626830 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-def114e3-898c-40b1-a264-cefda6cb4110 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:28.628053 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-def114e3-898c-40b1-a264-cefda6cb4110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:28.635720 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 475/967] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:57:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:57:28.690307 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f6203-399d-4f3e-913d-b7f9c4c6afb5 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:28.690587 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f6203-399d-4f3e-913d-b7f9c4c6afb5 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:28.690868 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f6203-399d-4f3e-913d-b7f9c4c6afb5 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:28.692400 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 493/968] 10.222.0.64 () {54 vars in 964 bytes} [Thu May 12 16:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:28.698366 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107ac86-bcbe-490c-81cb-bf4dc34564da None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:28.698655 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107ac86-bcbe-490c-81cb-bf4dc34564da None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:28.698935 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107ac86-bcbe-490c-81cb-bf4dc34564da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:28.716939 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-7107ac86-bcbe-490c-81cb-bf4dc34564da None None] MFA Rules not processed for user `b2cc0957b3e2402b8e6f47d46bfa02be`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:28.718158 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-7107ac86-bcbe-490c-81cb-bf4dc34564da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:28.724549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 476/969] 10.222.0.64 () {58 vars in 1061 bytes} [Thu May 12 16:57:28 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:57:28.734135 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f6203-399d-4f3e-913d-b7f9c4c6afb5 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:57:28.744511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f6203-399d-4f3e-913d-b7f9c4c6afb5 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:57:28.747984 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8db94-cfe3-49a6-aa15-f175c85a130f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:57:28.748611 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8db94-cfe3-49a6-aa15-f175c85a130f service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:28.748893 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8db94-cfe3-49a6-aa15-f175c85a130f service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:28.749167 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8db94-cfe3-49a6-aa15-f175c85a130f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:28.757790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8db94-cfe3-49a6-aa15-f175c85a130f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:57:28.759226 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8db94-cfe3-49a6-aa15-f175c85a130f service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:57:28.768369 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 494/970] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:57:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:57:34.551528 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fb149-642a-45b0-b87a-097d885a425f None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:34.552058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fb149-642a-45b0-b87a-097d885a425f None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:34.552135 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fb149-642a-45b0-b87a-097d885a425f None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:34.553805 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 477/971] 10.222.0.64 () {54 vars in 921 bytes} [Thu May 12 16:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:34.558843 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aa1e3-71dd-437f-8d5f-81007a77d4a2 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:34.559279 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aa1e3-71dd-437f-8d5f-81007a77d4a2 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:34.559395 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1aa1e3-71dd-437f-8d5f-81007a77d4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:34.598512 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-5f1aa1e3-71dd-437f-8d5f-81007a77d4a2 None None] MFA Rules not processed for user `8c64a6e5ef494d00817bb47cd6fd2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:34.600785 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-5f1aa1e3-71dd-437f-8d5f-81007a77d4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:34.674795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 495/972] 10.222.0.64 () {58 vars in 1018 bytes} [Thu May 12 16:57:34 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:57:39.021233 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f4cb8-1cfc-4cf5-b9e6-379c66adc27f None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:39.023815 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f4cb8-1cfc-4cf5-b9e6-379c66adc27f None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:39.023815 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f4cb8-1cfc-4cf5-b9e6-379c66adc27f None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:39.024016 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 478/973] 10.222.0.64 () {54 vars in 921 bytes} [Thu May 12 16:57:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:39.030867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247d063-ae6e-4b0b-ae4d-b1720420c684 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:39.031723 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247d063-ae6e-4b0b-ae4d-b1720420c684 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:39.032141 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247d063-ae6e-4b0b-ae4d-b1720420c684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:39.051424 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-f247d063-ae6e-4b0b-ae4d-b1720420c684 None None] MFA Rules not processed for user `8c64a6e5ef494d00817bb47cd6fd2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:39.052907 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-f247d063-ae6e-4b0b-ae4d-b1720420c684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:39.062529 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 496/974] 10.222.0.64 () {58 vars in 1018 bytes} [Thu May 12 16:57:39 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:57:40.596275 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e6b1a-59d8-4938-bc6a-6767d1716c9d None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:40.596764 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e6b1a-59d8-4938-bc6a-6767d1716c9d None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:40.596764 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e6b1a-59d8-4938-bc6a-6767d1716c9d None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:40.598142 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 479/975] 10.222.0.64 () {54 vars in 921 bytes} [Thu May 12 16:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:40.603857 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63032892-005f-478c-87a3-d69a6577bfa5 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:40.604289 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63032892-005f-478c-87a3-d69a6577bfa5 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:40.604471 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63032892-005f-478c-87a3-d69a6577bfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:40.621790 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-63032892-005f-478c-87a3-d69a6577bfa5 None None] MFA Rules not processed for user `8c64a6e5ef494d00817bb47cd6fd2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:40.623179 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-63032892-005f-478c-87a3-d69a6577bfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:40.631515 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 497/976] 10.222.0.64 () {58 vars in 1018 bytes} [Thu May 12 16:57:40 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:57:44.590685 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d7c9a-28f0-47ad-beb4-eabe2f93829a None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:44.591192 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d7c9a-28f0-47ad-beb4-eabe2f93829a None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:44.591192 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d7c9a-28f0-47ad-beb4-eabe2f93829a None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:44.597136 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 480/977] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:57:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:44.598648 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce6f38-4fbc-4884-bc93-18f2555c93be None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:44.599050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce6f38-4fbc-4884-bc93-18f2555c93be None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:44.599455 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce6f38-4fbc-4884-bc93-18f2555c93be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:44.645474 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-d9ce6f38-4fbc-4884-bc93-18f2555c93be None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:44.646841 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-d9ce6f38-4fbc-4884-bc93-18f2555c93be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:44.656011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 498/978] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:57:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:57:44.703825 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49c4bf-cf11-4822-a4f9-a92df0ddc342 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:44.704368 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49c4bf-cf11-4822-a4f9-a92df0ddc342 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:44.704760 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49c4bf-cf11-4822-a4f9-a92df0ddc342 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:44.706330 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 481/979] 10.222.0.64 () {54 vars in 961 bytes} [Thu May 12 16:57:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:44.711685 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8363b-3bef-4d5d-9d72-8f1811266a0e None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:44.712110 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8363b-3bef-4d5d-9d72-8f1811266a0e None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:44.712506 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8363b-3bef-4d5d-9d72-8f1811266a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:44.749385 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-6ea8363b-3bef-4d5d-9d72-8f1811266a0e None None] MFA Rules not processed for user `cd52d2543a9f4b5d9270a12544b0a021`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:44.750554 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-6ea8363b-3bef-4d5d-9d72-8f1811266a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:44.819459 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 499/980] 10.222.0.64 () {58 vars in 1058 bytes} [Thu May 12 16:57:44 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:57:44.827137 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49c4bf-cf11-4822-a4f9-a92df0ddc342 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:57:44.840896 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49c4bf-cf11-4822-a4f9-a92df0ddc342 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:57:44.845738 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd6b6c-c045-44c2-ae1d-6b5f081e62cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:57:44.846364 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd6b6c-c045-44c2-ae1d-6b5f081e62cf service nova] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:44.846642 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd6b6c-c045-44c2-ae1d-6b5f081e62cf service nova] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:44.846912 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd6b6c-c045-44c2-ae1d-6b5f081e62cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:44.855977 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd6b6c-c045-44c2-ae1d-6b5f081e62cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:57:44.857712 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd6b6c-c045-44c2-ae1d-6b5f081e62cf service nova] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:57:44.868360 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 482/981] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:57:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:57:47.407516 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb0bf3-e643-4af5-b74a-73176bdf2994 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:47.408138 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb0bf3-e643-4af5-b74a-73176bdf2994 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:47.408244 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb0bf3-e643-4af5-b74a-73176bdf2994 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:47.409713 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 500/982] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:47.415446 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e136d7e-b312-4a9f-a951-1eacae8384e3 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:47.415893 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e136d7e-b312-4a9f-a951-1eacae8384e3 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:47.416044 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e136d7e-b312-4a9f-a951-1eacae8384e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:47.433605 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-2e136d7e-b312-4a9f-a951-1eacae8384e3 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:47.435026 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-2e136d7e-b312-4a9f-a951-1eacae8384e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:47.442933 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 483/983] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:57:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:57:47.489583 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb0bf3-e643-4af5-b74a-73176bdf2994 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:57:47.504560 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb0bf3-e643-4af5-b74a-73176bdf2994 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:57:47.511050 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e0386-b9ef-4001-832f-5c394c3e16c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:57:47.511982 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e0386-b9ef-4001-832f-5c394c3e16c4 service nova] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:47.512587 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e0386-b9ef-4001-832f-5c394c3e16c4 service nova] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:47.513067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e0386-b9ef-4001-832f-5c394c3e16c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:47.522815 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e0386-b9ef-4001-832f-5c394c3e16c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:57:47.524619 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e0386-b9ef-4001-832f-5c394c3e16c4 service nova] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:57:47.534916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 501/984] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:57:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:57:50.130120 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5bda3-184d-427c-964e-c9a08fcd6e5c None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:50.130641 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5bda3-184d-427c-964e-c9a08fcd6e5c None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:50.130641 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5bda3-184d-427c-964e-c9a08fcd6e5c None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:50.132636 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 484/985] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:57:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:50.138233 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33ed4f-3b49-48bf-8518-f3424f471339 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:50.138691 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33ed4f-3b49-48bf-8518-f3424f471339 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:50.138786 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33ed4f-3b49-48bf-8518-f3424f471339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:50.160045 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-3b33ed4f-3b49-48bf-8518-f3424f471339 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:50.161830 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-3b33ed4f-3b49-48bf-8518-f3424f471339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:50.173235 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 502/986] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:57:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:57:50.220634 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c45684-3c1d-4bb9-a1d8-49946799a354 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:50.220989 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c45684-3c1d-4bb9-a1d8-49946799a354 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:50.221335 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c45684-3c1d-4bb9-a1d8-49946799a354 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:50.222892 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 485/987] 10.222.0.64 () {54 vars in 961 bytes} [Thu May 12 16:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:50.228665 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f48c3-e867-438f-99ca-7b96ddcc9346 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:50.228953 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f48c3-e867-438f-99ca-7b96ddcc9346 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:50.229231 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f48c3-e867-438f-99ca-7b96ddcc9346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:50.247398 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-190f48c3-e867-438f-99ca-7b96ddcc9346 None None] MFA Rules not processed for user `cd52d2543a9f4b5d9270a12544b0a021`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:50.248584 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-190f48c3-e867-438f-99ca-7b96ddcc9346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:50.257495 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 503/988] 10.222.0.64 () {58 vars in 1058 bytes} [Thu May 12 16:57:50 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:57:50.265039 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c45684-3c1d-4bb9-a1d8-49946799a354 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:57:50.277975 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c45684-3c1d-4bb9-a1d8-49946799a354 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:57:50.282878 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231d1c0-7ae9-451a-8980-bcf06fcab566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:57:50.283550 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231d1c0-7ae9-451a-8980-bcf06fcab566 service nova] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:50.284012 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231d1c0-7ae9-451a-8980-bcf06fcab566 service nova] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:50.284287 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231d1c0-7ae9-451a-8980-bcf06fcab566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:50.292464 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231d1c0-7ae9-451a-8980-bcf06fcab566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:57:50.294039 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231d1c0-7ae9-451a-8980-bcf06fcab566 service nova] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:57:50.303851 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 486/989] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:57:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:57:52.742161 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bda05-c366-4749-929d-06c61f93d377 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:52.743214 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bda05-c366-4749-929d-06c61f93d377 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:52.743751 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bda05-c366-4749-929d-06c61f93d377 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:52.745337 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 504/990] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:57:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:57:52.750919 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6173a4b-97c9-4f31-961f-c7734106e3d0 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:52.751769 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6173a4b-97c9-4f31-961f-c7734106e3d0 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:52.752255 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6173a4b-97c9-4f31-961f-c7734106e3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:52.771877 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-e6173a4b-97c9-4f31-961f-c7734106e3d0 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:52.773402 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-e6173a4b-97c9-4f31-961f-c7734106e3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:52.797473 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 487/991] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:57:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:57:52.852692 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bda05-c366-4749-929d-06c61f93d377 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:57:52.869824 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bda05-c366-4749-929d-06c61f93d377 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:57:52.875471 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a58da-3405-4b38-8222-734d8c8f1c03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:57:52.876661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a58da-3405-4b38-8222-734d8c8f1c03 service nova] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:52.877152 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a58da-3405-4b38-8222-734d8c8f1c03 service nova] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:52.877634 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a58da-3405-4b38-8222-734d8c8f1c03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:52.887438 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a58da-3405-4b38-8222-734d8c8f1c03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:57:52.889880 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a58da-3405-4b38-8222-734d8c8f1c03 service nova] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:57:52.902145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 505/992] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:57:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:57:54.563613 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc0c1a-c0bb-4e19-a6bd-abf54e7113d4 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:54.570786 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc0c1a-c0bb-4e19-a6bd-abf54e7113d4 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:54.571079 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc0c1a-c0bb-4e19-a6bd-abf54e7113d4 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:54.578318 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 488/993] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:57:54 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:54.581233 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e243c5-6b01-4d7b-910f-d57435002d51 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:54.582075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e243c5-6b01-4d7b-910f-d57435002d51 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:54.582608 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e243c5-6b01-4d7b-910f-d57435002d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:54.603450 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-e9e243c5-6b01-4d7b-910f-d57435002d51 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:54.608994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-e9e243c5-6b01-4d7b-910f-d57435002d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:54.651061 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 506/994] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:57:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:57:55.008528 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9207f1-dd36-4150-8058-8dede259943e None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:55.008816 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9207f1-dd36-4150-8058-8dede259943e None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:55.009096 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9207f1-dd36-4150-8058-8dede259943e None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:55.010460 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 489/995] 10.222.0.64 () {54 vars in 963 bytes} [Thu May 12 16:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:55.015693 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05549fb-9987-4190-a408-2cc7d86d4eaf None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:55.015978 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05549fb-9987-4190-a408-2cc7d86d4eaf None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:55.016261 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05549fb-9987-4190-a408-2cc7d86d4eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:55.051052 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-c05549fb-9987-4190-a408-2cc7d86d4eaf None None] MFA Rules not processed for user `83541095ea5646038feef0764f0473c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:55.052382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-c05549fb-9987-4190-a408-2cc7d86d4eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:55.123671 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 507/996] 10.222.0.64 () {58 vars in 1060 bytes} [Thu May 12 16:57:55 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:57:55.131410 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9207f1-dd36-4150-8058-8dede259943e None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:57:55.142057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9207f1-dd36-4150-8058-8dede259943e None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:57:55.145754 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869eaa84-5335-432f-a937-fac553ffe90a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83541095ea5646038feef0764f0473c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:57:55.146591 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869eaa84-5335-432f-a937-fac553ffe90a service cinder] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:55.147036 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869eaa84-5335-432f-a937-fac553ffe90a service cinder] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:55.147477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869eaa84-5335-432f-a937-fac553ffe90a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:55.157006 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869eaa84-5335-432f-a937-fac553ffe90a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:57:55.158623 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869eaa84-5335-432f-a937-fac553ffe90a service cinder] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:57:55.170827 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 490/997] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:57:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:57:55.373429 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8568a-0834-4c65-b3e9-7cfc7a4e65ea None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:55.373722 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8568a-0834-4c65-b3e9-7cfc7a4e65ea None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:55.374213 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8568a-0834-4c65-b3e9-7cfc7a4e65ea None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:55.375897 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 508/998] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:55.381014 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dc094-fb63-454e-9229-ba61154c5c06 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:55.381301 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dc094-fb63-454e-9229-ba61154c5c06 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:55.381577 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436dc094-fb63-454e-9229-ba61154c5c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:55.399047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-436dc094-fb63-454e-9229-ba61154c5c06 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:55.400253 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-436dc094-fb63-454e-9229-ba61154c5c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:55.408086 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 491/999] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:57:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:57:55.453414 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8568a-0834-4c65-b3e9-7cfc7a4e65ea None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:57:55.467257 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8568a-0834-4c65-b3e9-7cfc7a4e65ea None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:57:55.472133 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee9ce6-4297-4947-8e68-ab5b0ad96e9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:57:55.472765 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee9ce6-4297-4947-8e68-ab5b0ad96e9e service nova] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:55.473045 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee9ce6-4297-4947-8e68-ab5b0ad96e9e service nova] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:55.473318 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee9ce6-4297-4947-8e68-ab5b0ad96e9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:55.482440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee9ce6-4297-4947-8e68-ab5b0ad96e9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:57:55.484073 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee9ce6-4297-4947-8e68-ab5b0ad96e9e service nova] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:57:55.493780 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 509/1000] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:57:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:57:57.879030 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c338152-1fab-4d0e-905f-8c626da3f932 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:57.879532 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c338152-1fab-4d0e-905f-8c626da3f932 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:57.879610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c338152-1fab-4d0e-905f-8c626da3f932 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:57.881026 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 492/1001] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:57:57.886409 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c94580-e720-4d5d-b429-a9d3226b2aaf None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:57.886802 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c94580-e720-4d5d-b429-a9d3226b2aaf None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:57.886968 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c94580-e720-4d5d-b429-a9d3226b2aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:57.905183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-66c94580-e720-4d5d-b429-a9d3226b2aaf None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:57:57.906380 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-66c94580-e720-4d5d-b429-a9d3226b2aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:57:57.916479 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 510/1002] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:57:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:57:57.960690 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c338152-1fab-4d0e-905f-8c626da3f932 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:57:57.973988 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c338152-1fab-4d0e-905f-8c626da3f932 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:57:57.980212 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7293bbd-9983-43c0-8c99-bf5313b38bff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:57:57.980845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7293bbd-9983-43c0-8c99-bf5313b38bff service nova] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:57:57.981127 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7293bbd-9983-43c0-8c99-bf5313b38bff service nova] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:57:57.981403 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7293bbd-9983-43c0-8c99-bf5313b38bff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:57:57.989409 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7293bbd-9983-43c0-8c99-bf5313b38bff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:57:57.991031 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7293bbd-9983-43c0-8c99-bf5313b38bff service nova] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:57:58.000255 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 493/1003] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:57:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:00.336021 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814b86b-ea46-435f-b5e8-70487e1ed3b1 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:00.336549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814b86b-ea46-435f-b5e8-70487e1ed3b1 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:00.336666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814b86b-ea46-435f-b5e8-70487e1ed3b1 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:00.338112 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 511/1004] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:00.343619 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014b9e1-e1c4-438e-b4ff-0035bf585bd1 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:00.344047 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014b9e1-e1c4-438e-b4ff-0035bf585bd1 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:00.344214 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014b9e1-e1c4-438e-b4ff-0035bf585bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:00.362203 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-0014b9e1-e1c4-438e-b4ff-0035bf585bd1 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:00.363394 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-0014b9e1-e1c4-438e-b4ff-0035bf585bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:00.371704 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 494/1005] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:58:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:00.414565 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814b86b-ea46-435f-b5e8-70487e1ed3b1 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:00.428815 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814b86b-ea46-435f-b5e8-70487e1ed3b1 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:00.434058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d0c84-a273-4feb-8191-912c4ef34537 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:00.434795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d0c84-a273-4feb-8191-912c4ef34537 service nova] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:00.435178 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d0c84-a273-4feb-8191-912c4ef34537 service nova] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:00.435585 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d0c84-a273-4feb-8191-912c4ef34537 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:00.443975 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d0c84-a273-4feb-8191-912c4ef34537 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:00.445709 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d0c84-a273-4feb-8191-912c4ef34537 service nova] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:00.455352 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 512/1006] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:02.849693 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569d5ee-3bfa-4eac-abc2-87f446ce9b7a None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:02.850252 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569d5ee-3bfa-4eac-abc2-87f446ce9b7a None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:02.850252 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569d5ee-3bfa-4eac-abc2-87f446ce9b7a None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:02.851881 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 495/1007] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:02.857061 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81675e-a865-4e39-8436-c3d981253715 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:02.857527 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81675e-a865-4e39-8436-c3d981253715 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:02.857652 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81675e-a865-4e39-8436-c3d981253715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:02.875452 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-be81675e-a865-4e39-8436-c3d981253715 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:02.876658 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-be81675e-a865-4e39-8436-c3d981253715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:02.884898 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 513/1008] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:58:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:02.928816 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569d5ee-3bfa-4eac-abc2-87f446ce9b7a None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:02.942715 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569d5ee-3bfa-4eac-abc2-87f446ce9b7a None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:02.948085 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f34dd-7def-422e-b184-beb4db390e78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:02.949011 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f34dd-7def-422e-b184-beb4db390e78 service nova] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:02.949221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f34dd-7def-422e-b184-beb4db390e78 service nova] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:02.949500 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f34dd-7def-422e-b184-beb4db390e78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:02.957793 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f34dd-7def-422e-b184-beb4db390e78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:02.960500 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f34dd-7def-422e-b184-beb4db390e78 service nova] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:02.971797 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 496/1009] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:05.359310 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f9e66-ff64-4d68-a4e4-3c9b633bf452 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:05.367771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f9e66-ff64-4d68-a4e4-3c9b633bf452 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:05.367771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f9e66-ff64-4d68-a4e4-3c9b633bf452 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:05.367771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 514/1010] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:05.368195 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdae54-fcb3-4f39-bade-febcd1b3683a None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:05.368195 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdae54-fcb3-4f39-bade-febcd1b3683a None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:05.368195 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdae54-fcb3-4f39-bade-febcd1b3683a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:05.385227 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-0ffdae54-fcb3-4f39-bade-febcd1b3683a None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:05.386482 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-0ffdae54-fcb3-4f39-bade-febcd1b3683a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:05.394574 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 497/1011] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:58:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:05.458055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f9e66-ff64-4d68-a4e4-3c9b633bf452 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:05.476346 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f9e66-ff64-4d68-a4e4-3c9b633bf452 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:05.482315 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca00e4-eedf-48e6-9db4-5402c760bd4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:05.482982 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca00e4-eedf-48e6-9db4-5402c760bd4c service nova] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:05.483263 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca00e4-eedf-48e6-9db4-5402c760bd4c service nova] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:05.483537 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca00e4-eedf-48e6-9db4-5402c760bd4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:05.492813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca00e4-eedf-48e6-9db4-5402c760bd4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:05.494443 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca00e4-eedf-48e6-9db4-5402c760bd4c service nova] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:05.506558 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 515/1012] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:08.278299 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30103858-6623-43eb-91de-5c7072140ba0 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:08.279063 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30103858-6623-43eb-91de-5c7072140ba0 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:08.279063 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30103858-6623-43eb-91de-5c7072140ba0 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:08.280312 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 498/1013] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:08.285740 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e0c30-a457-419e-913a-d9083e0d3361 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:08.286309 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e0c30-a457-419e-913a-d9083e0d3361 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:08.286309 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e0c30-a457-419e-913a-d9083e0d3361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:08.312035 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-a79e0c30-a457-419e-913a-d9083e0d3361 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:08.317277 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-a79e0c30-a457-419e-913a-d9083e0d3361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:08.325496 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 516/1014] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:58:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:08.377728 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30103858-6623-43eb-91de-5c7072140ba0 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:08.390901 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30103858-6623-43eb-91de-5c7072140ba0 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:08.395966 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52791bff-af1a-4086-97ed-71c6b504aea8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:08.397106 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52791bff-af1a-4086-97ed-71c6b504aea8 service nova] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:08.397400 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52791bff-af1a-4086-97ed-71c6b504aea8 service nova] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:08.397685 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52791bff-af1a-4086-97ed-71c6b504aea8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:08.405841 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52791bff-af1a-4086-97ed-71c6b504aea8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:08.407453 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52791bff-af1a-4086-97ed-71c6b504aea8 service nova] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:08.417331 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 499/1015] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:10.815408 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eb4e5-2302-4c0b-b973-93ca011fd0b7 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:10.816111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eb4e5-2302-4c0b-b973-93ca011fd0b7 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:10.816111 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6eb4e5-2302-4c0b-b973-93ca011fd0b7 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:10.817396 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 517/1016] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:10.823467 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93e5be-8969-4f15-9765-8893006d555c None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:10.823951 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93e5be-8969-4f15-9765-8893006d555c None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:10.824057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93e5be-8969-4f15-9765-8893006d555c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:10.841353 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-7b93e5be-8969-4f15-9765-8893006d555c None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:10.842537 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-7b93e5be-8969-4f15-9765-8893006d555c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:10.850766 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 500/1017] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:58:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:10.894675 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eb4e5-2302-4c0b-b973-93ca011fd0b7 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:10.908925 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6eb4e5-2302-4c0b-b973-93ca011fd0b7 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:10.914397 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44001e85-7e2c-4e1c-a3bf-06cd7c1ec7e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:10.915041 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44001e85-7e2c-4e1c-a3bf-06cd7c1ec7e4 service nova] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:10.915321 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44001e85-7e2c-4e1c-a3bf-06cd7c1ec7e4 service nova] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:10.915596 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44001e85-7e2c-4e1c-a3bf-06cd7c1ec7e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:10.924040 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44001e85-7e2c-4e1c-a3bf-06cd7c1ec7e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:10.925630 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44001e85-7e2c-4e1c-a3bf-06cd7c1ec7e4 service nova] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:10.935604 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 518/1018] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:11.213286 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc254043-0b8b-4499-bdbb-35008f3227c3 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:11.213574 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc254043-0b8b-4499-bdbb-35008f3227c3 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:11.213852 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc254043-0b8b-4499-bdbb-35008f3227c3 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:11.215307 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 501/1019] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:11.220721 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037281a-240c-493f-be1f-3475718f200f None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:11.221013 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037281a-240c-493f-be1f-3475718f200f None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:11.221292 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037281a-240c-493f-be1f-3475718f200f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:11.239232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-2037281a-240c-493f-be1f-3475718f200f None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:11.240459 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-2037281a-240c-493f-be1f-3475718f200f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:11.248128 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 519/1020] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:58:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:11.304971 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012291e4-22fb-401d-bb67-03582b3087ea None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:11.305265 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012291e4-22fb-401d-bb67-03582b3087ea None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:11.305551 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012291e4-22fb-401d-bb67-03582b3087ea None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:11.306970 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 502/1021] 10.222.0.64 () {54 vars in 962 bytes} [Thu May 12 16:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:11.312029 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602de5d1-69d0-497c-b757-4f8c3f14ee15 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:11.312396 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602de5d1-69d0-497c-b757-4f8c3f14ee15 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:11.312680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602de5d1-69d0-497c-b757-4f8c3f14ee15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:11.348437 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-602de5d1-69d0-497c-b757-4f8c3f14ee15 None None] MFA Rules not processed for user `deb66d4bda564438852a38a4a4116ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:11.350254 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-602de5d1-69d0-497c-b757-4f8c3f14ee15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:11.407962 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 520/1022] 10.222.0.64 () {58 vars in 1059 bytes} [Thu May 12 16:58:11 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:11.423438 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012291e4-22fb-401d-bb67-03582b3087ea None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:11.434290 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012291e4-22fb-401d-bb67-03582b3087ea None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:11.437877 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168f155-385b-4e15-9e36-de55756850ec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deb66d4bda564438852a38a4a4116ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:11.438534 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168f155-385b-4e15-9e36-de55756850ec service glance] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:11.438819 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168f155-385b-4e15-9e36-de55756850ec service glance] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:11.439103 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168f155-385b-4e15-9e36-de55756850ec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:11.451909 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168f155-385b-4e15-9e36-de55756850ec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:11.453677 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168f155-385b-4e15-9e36-de55756850ec service glance] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:11.468885 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 503/1023] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:13.258932 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7241c7-df1d-4bfb-b459-0bac87127ed9 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:13.259586 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7241c7-df1d-4bfb-b459-0bac87127ed9 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:13.260136 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7241c7-df1d-4bfb-b459-0bac87127ed9 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:13.262393 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 521/1024] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:13.267313 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f3e7f-b421-4db2-9aaa-c78621ea0c8c None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:13.267872 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f3e7f-b421-4db2-9aaa-c78621ea0c8c None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:13.267872 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f3e7f-b421-4db2-9aaa-c78621ea0c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:13.285991 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-748f3e7f-b421-4db2-9aaa-c78621ea0c8c None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:13.287759 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-748f3e7f-b421-4db2-9aaa-c78621ea0c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:13.297296 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 504/1025] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:58:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:13.342267 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7241c7-df1d-4bfb-b459-0bac87127ed9 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:13.356271 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7241c7-df1d-4bfb-b459-0bac87127ed9 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:13.361129 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ffbd28-a681-48b2-83b1-ac4fe97335a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:13.361778 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffbd28-a681-48b2-83b1-ac4fe97335a6 service nova] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:13.362063 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffbd28-a681-48b2-83b1-ac4fe97335a6 service nova] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:13.362349 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ffbd28-a681-48b2-83b1-ac4fe97335a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:13.371470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ffbd28-a681-48b2-83b1-ac4fe97335a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:13.373099 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ffbd28-a681-48b2-83b1-ac4fe97335a6 service nova] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:13.382777 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 522/1026] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:26.480218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010feff-fe86-4f90-b764-d9f0bac0feae None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:26.480837 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010feff-fe86-4f90-b764-d9f0bac0feae None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:26.480837 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010feff-fe86-4f90-b764-d9f0bac0feae None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:26.482592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 505/1027] 10.222.0.64 () {54 vars in 918 bytes} [Thu May 12 16:58:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:26.487900 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1296c5-bf33-4531-8fa2-0ce1ceccdc4e None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:26.488422 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1296c5-bf33-4531-8fa2-0ce1ceccdc4e None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:26.488532 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1296c5-bf33-4531-8fa2-0ce1ceccdc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:26.506441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-6b1296c5-bf33-4531-8fa2-0ce1ceccdc4e None None] MFA Rules not processed for user `8c64a6e5ef494d00817bb47cd6fd2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:26.507621 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-6b1296c5-bf33-4531-8fa2-0ce1ceccdc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:26.516059 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 523/1028] 10.222.0.64 () {58 vars in 1015 bytes} [Thu May 12 16:58:26 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:58:26.530624 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b27b45-6358-43e7-a148-fb0f8057e1b3 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:26.530914 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b27b45-6358-43e7-a148-fb0f8057e1b3 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:26.531193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b27b45-6358-43e7-a148-fb0f8057e1b3 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:26.532600 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 506/1029] 10.222.0.64 () {54 vars in 918 bytes} [Thu May 12 16:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:26.537695 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd22c1c-e5d1-4473-9187-357d9936c78e None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:26.537980 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd22c1c-e5d1-4473-9187-357d9936c78e None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:26.538259 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd22c1c-e5d1-4473-9187-357d9936c78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:26.556120 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-7cd22c1c-e5d1-4473-9187-357d9936c78e None None] MFA Rules not processed for user `cd52d2543a9f4b5d9270a12544b0a021`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:26.557294 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-7cd22c1c-e5d1-4473-9187-357d9936c78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:26.565645 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 524/1030] 10.222.0.64 () {58 vars in 1015 bytes} [Thu May 12 16:58:26 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:58:29.298221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcd698-8173-46b5-9fb2-591af14a084c None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:29.298747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcd698-8173-46b5-9fb2-591af14a084c None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:29.298747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcd698-8173-46b5-9fb2-591af14a084c None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:29.300099 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 507/1031] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:29.305242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444862-73bc-44e0-8fc4-efc71d5b6658 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:29.305675 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444862-73bc-44e0-8fc4-efc71d5b6658 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:29.305783 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4444862-73bc-44e0-8fc4-efc71d5b6658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:29.322894 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-d4444862-73bc-44e0-8fc4-efc71d5b6658 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:29.324114 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-d4444862-73bc-44e0-8fc4-efc71d5b6658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:29.331818 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 525/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:58:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:29.374536 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcd698-8173-46b5-9fb2-591af14a084c None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:29.387919 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcd698-8173-46b5-9fb2-591af14a084c None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:29.392812 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29e93f-2c20-4fa4-835a-8cb79e25c2d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:29.393442 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29e93f-2c20-4fa4-835a-8cb79e25c2d7 service nova] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:29.393724 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29e93f-2c20-4fa4-835a-8cb79e25c2d7 service nova] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:29.394001 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29e93f-2c20-4fa4-835a-8cb79e25c2d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:29.402372 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29e93f-2c20-4fa4-835a-8cb79e25c2d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:29.404010 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29e93f-2c20-4fa4-835a-8cb79e25c2d7 service nova] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:29.413935 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 508/1033] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:30.413798 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14e433-96c5-487a-ac13-e31e21b5cadd None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:30.414348 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14e433-96c5-487a-ac13-e31e21b5cadd None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:30.414348 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14e433-96c5-487a-ac13-e31e21b5cadd None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:30.415784 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 526/1034] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 16:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:30.420745 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2191e16-5dd4-41fa-893a-21ae2e245788 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:30.421154 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2191e16-5dd4-41fa-893a-21ae2e245788 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:30.421342 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2191e16-5dd4-41fa-893a-21ae2e245788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:30.439738 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-d2191e16-5dd4-41fa-893a-21ae2e245788 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:30.440927 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-d2191e16-5dd4-41fa-893a-21ae2e245788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:30.448948 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 509/1035] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 16:58:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:30.650877 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14e433-96c5-487a-ac13-e31e21b5cadd None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:30.664689 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14e433-96c5-487a-ac13-e31e21b5cadd None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:30.669518 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ebef0-3ff4-4720-915c-17788c826a0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:30.670145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ebef0-3ff4-4720-915c-17788c826a0c service nova] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:30.670425 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ebef0-3ff4-4720-915c-17788c826a0c service nova] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:30.670700 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ebef0-3ff4-4720-915c-17788c826a0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:30.679183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ebef0-3ff4-4720-915c-17788c826a0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:30.680796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ebef0-3ff4-4720-915c-17788c826a0c service nova] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:30.689874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 527/1036] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:31.654200 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e3af7-9786-4632-83ae-97877ebc34c6 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:31.654780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e3af7-9786-4632-83ae-97877ebc34c6 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:31.654780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e3af7-9786-4632-83ae-97877ebc34c6 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:31.656135 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 510/1037] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 16:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:31.660953 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baa033-fcd7-4ec8-8f62-9364f503547f None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:31.661376 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baa033-fcd7-4ec8-8f62-9364f503547f None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:31.661513 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92baa033-fcd7-4ec8-8f62-9364f503547f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:31.679360 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-92baa033-fcd7-4ec8-8f62-9364f503547f None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:31.680589 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-92baa033-fcd7-4ec8-8f62-9364f503547f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:31.688312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 528/1038] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 16:58:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:31.840903 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e3af7-9786-4632-83ae-97877ebc34c6 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:31.854691 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e3af7-9786-4632-83ae-97877ebc34c6 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:31.859696 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93178bf9-3bac-4ada-b76b-6c6e266c8cd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:31.860329 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93178bf9-3bac-4ada-b76b-6c6e266c8cd1 service nova] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:31.860614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93178bf9-3bac-4ada-b76b-6c6e266c8cd1 service nova] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:31.860891 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93178bf9-3bac-4ada-b76b-6c6e266c8cd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:31.869404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93178bf9-3bac-4ada-b76b-6c6e266c8cd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:31.871012 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93178bf9-3bac-4ada-b76b-6c6e266c8cd1 service nova] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:31.880200 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 511/1039] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:32.812509 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b519e-25ad-4f1a-9e37-87621e4e3311 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:32.813075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b519e-25ad-4f1a-9e37-87621e4e3311 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:32.813075 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b519e-25ad-4f1a-9e37-87621e4e3311 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:32.814426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 529/1040] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 16:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:32.820009 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968aa301-f6ca-4bda-8784-4d29da199494 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:32.820410 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968aa301-f6ca-4bda-8784-4d29da199494 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:32.820565 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968aa301-f6ca-4bda-8784-4d29da199494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:32.839255 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-968aa301-f6ca-4bda-8784-4d29da199494 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:32.840475 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-968aa301-f6ca-4bda-8784-4d29da199494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:32.848302 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 512/1041] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 16:58:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:33.001611 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b519e-25ad-4f1a-9e37-87621e4e3311 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:33.015416 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b519e-25ad-4f1a-9e37-87621e4e3311 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:33.020442 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12342db0-be5a-4bfb-b87c-cd339ceee729 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:33.021082 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12342db0-be5a-4bfb-b87c-cd339ceee729 service nova] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:33.021362 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12342db0-be5a-4bfb-b87c-cd339ceee729 service nova] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:33.021637 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12342db0-be5a-4bfb-b87c-cd339ceee729 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:33.029669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12342db0-be5a-4bfb-b87c-cd339ceee729 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:33.031235 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12342db0-be5a-4bfb-b87c-cd339ceee729 service nova] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:33.040281 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 530/1042] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:33.967912 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f663e-34b6-46bf-ae94-8b9961d51889 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:33.968432 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f663e-34b6-46bf-ae94-8b9961d51889 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:33.968530 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f663e-34b6-46bf-ae94-8b9961d51889 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:33.969828 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 513/1043] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 16:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:33.975191 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e693f-68b8-4c74-8227-210bc65824a2 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:33.975589 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e693f-68b8-4c74-8227-210bc65824a2 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:33.975763 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e693f-68b8-4c74-8227-210bc65824a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:33.993138 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-a40e693f-68b8-4c74-8227-210bc65824a2 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:33.994301 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-a40e693f-68b8-4c74-8227-210bc65824a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:34.001874 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 531/1044] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 16:58:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:34.155918 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f663e-34b6-46bf-ae94-8b9961d51889 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:34.168992 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f663e-34b6-46bf-ae94-8b9961d51889 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:34.173776 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59460629-7494-4444-9f59-2eaae0556a0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:34.174405 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59460629-7494-4444-9f59-2eaae0556a0d service nova] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:34.174685 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59460629-7494-4444-9f59-2eaae0556a0d service nova] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:34.174961 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59460629-7494-4444-9f59-2eaae0556a0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:34.182744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59460629-7494-4444-9f59-2eaae0556a0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:34.184355 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59460629-7494-4444-9f59-2eaae0556a0d service nova] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:34.194134 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 514/1045] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:35.075966 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb9f19-71c2-45ce-8495-77f35c256ecf None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:35.076523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb9f19-71c2-45ce-8495-77f35c256ecf None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:35.076523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb9f19-71c2-45ce-8495-77f35c256ecf None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:35.077907 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 532/1046] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 16:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:35.082951 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f1c08-e680-49c2-83d2-a5b0753d8544 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:35.083623 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f1c08-e680-49c2-83d2-a5b0753d8544 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:35.083808 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f1c08-e680-49c2-83d2-a5b0753d8544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:35.103987 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-ff3f1c08-e680-49c2-83d2-a5b0753d8544 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:35.105183 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-ff3f1c08-e680-49c2-83d2-a5b0753d8544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:35.112964 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 515/1047] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 16:58:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:35.265887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb9f19-71c2-45ce-8495-77f35c256ecf None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:35.279534 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb9f19-71c2-45ce-8495-77f35c256ecf None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:35.284446 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f71688-ea6d-4373-9b8f-0e8b7909b8e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:35.285079 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f71688-ea6d-4373-9b8f-0e8b7909b8e9 service nova] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:35.285364 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f71688-ea6d-4373-9b8f-0e8b7909b8e9 service nova] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:35.285643 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f71688-ea6d-4373-9b8f-0e8b7909b8e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:35.294213 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f71688-ea6d-4373-9b8f-0e8b7909b8e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:35.295835 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f71688-ea6d-4373-9b8f-0e8b7909b8e9 service nova] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:35.305042 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 533/1048] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:36.166149 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49afd1-1c2a-442d-aabc-c3dc23385f23 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:36.166694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49afd1-1c2a-442d-aabc-c3dc23385f23 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:36.166694 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49afd1-1c2a-442d-aabc-c3dc23385f23 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:36.168277 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 516/1049] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 16:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:36.173036 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b9313-0ae8-4822-bb86-78033e77c066 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:36.173482 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b9313-0ae8-4822-bb86-78033e77c066 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:36.173581 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b9313-0ae8-4822-bb86-78033e77c066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:36.191596 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-230b9313-0ae8-4822-bb86-78033e77c066 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:36.193568 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-230b9313-0ae8-4822-bb86-78033e77c066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:36.201304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 534/1050] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 16:58:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:36.352979 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49afd1-1c2a-442d-aabc-c3dc23385f23 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:36.366690 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49afd1-1c2a-442d-aabc-c3dc23385f23 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:36.371737 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e40c4-8d9a-451b-b034-9f1c3c027c5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:36.372380 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e40c4-8d9a-451b-b034-9f1c3c027c5f service nova] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:36.372659 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e40c4-8d9a-451b-b034-9f1c3c027c5f service nova] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:36.372930 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e40c4-8d9a-451b-b034-9f1c3c027c5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:36.385409 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e40c4-8d9a-451b-b034-9f1c3c027c5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:36.386993 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e40c4-8d9a-451b-b034-9f1c3c027c5f service nova] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:36.396151 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 517/1051] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:37.266797 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6b6b9-e75e-4570-b5b3-aef26331cf31 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:37.267328 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6b6b9-e75e-4570-b5b3-aef26331cf31 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:37.267328 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6b6b9-e75e-4570-b5b3-aef26331cf31 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:37.268694 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 535/1052] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 16:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:37.274045 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ff7ff-8fa4-4f37-9338-45b2ca854310 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:37.274480 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ff7ff-8fa4-4f37-9338-45b2ca854310 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:37.274585 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ff7ff-8fa4-4f37-9338-45b2ca854310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:37.291915 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-850ff7ff-8fa4-4f37-9338-45b2ca854310 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:37.293096 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-850ff7ff-8fa4-4f37-9338-45b2ca854310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:37.300688 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 518/1053] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 16:58:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:37.468091 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6b6b9-e75e-4570-b5b3-aef26331cf31 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:37.481590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6b6b9-e75e-4570-b5b3-aef26331cf31 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:37.486456 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7737e-6732-4aad-a8cc-1a17804938a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:37.487090 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7737e-6732-4aad-a8cc-1a17804938a7 service nova] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:37.487376 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7737e-6732-4aad-a8cc-1a17804938a7 service nova] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:37.487668 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7737e-6732-4aad-a8cc-1a17804938a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:37.497290 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7737e-6732-4aad-a8cc-1a17804938a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:37.498892 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7737e-6732-4aad-a8cc-1a17804938a7 service nova] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:37.508876 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 536/1054] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:38.380899 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098b3bf-cc9c-4a0c-8d91-f5aec3bb852f None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:38.381448 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098b3bf-cc9c-4a0c-8d91-f5aec3bb852f None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:38.381448 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098b3bf-cc9c-4a0c-8d91-f5aec3bb852f None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:38.382788 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 519/1055] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 16:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:38.387823 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3730b-efca-47bc-b7be-53688d4365f2 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:38.388220 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3730b-efca-47bc-b7be-53688d4365f2 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:38.388385 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3730b-efca-47bc-b7be-53688d4365f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:38.405771 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-2ea3730b-efca-47bc-b7be-53688d4365f2 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:38.406956 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-2ea3730b-efca-47bc-b7be-53688d4365f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:38.414643 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 537/1056] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 16:58:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:38.564690 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098b3bf-cc9c-4a0c-8d91-f5aec3bb852f None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:38.578167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098b3bf-cc9c-4a0c-8d91-f5aec3bb852f None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:38.583916 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ded48d-5d0a-4ffa-9a79-974c676ea4ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:38.584563 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ded48d-5d0a-4ffa-9a79-974c676ea4ef service nova] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:38.584843 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ded48d-5d0a-4ffa-9a79-974c676ea4ef service nova] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:38.585117 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ded48d-5d0a-4ffa-9a79-974c676ea4ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:38.593180 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ded48d-5d0a-4ffa-9a79-974c676ea4ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:38.594757 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ded48d-5d0a-4ffa-9a79-974c676ea4ef service nova] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:38.604705 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 520/1057] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:40.726249 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e76fa-081a-4a72-9d6a-81ac1e6a9102 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:40.727046 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e76fa-081a-4a72-9d6a-81ac1e6a9102 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:40.727046 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e76fa-081a-4a72-9d6a-81ac1e6a9102 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:40.728452 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 538/1058] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:40.733597 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1201dc-9d2c-4674-aebb-a8357edb2f06 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:40.734033 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1201dc-9d2c-4674-aebb-a8357edb2f06 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:40.734140 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1201dc-9d2c-4674-aebb-a8357edb2f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:40.751575 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-2b1201dc-9d2c-4674-aebb-a8357edb2f06 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:40.752793 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-2b1201dc-9d2c-4674-aebb-a8357edb2f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:40.760460 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 521/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:58:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:40.799182 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e76fa-081a-4a72-9d6a-81ac1e6a9102 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:40.809479 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e76fa-081a-4a72-9d6a-81ac1e6a9102 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:40.812898 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d344d-6b60-44b3-9144-41f2286615db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:40.813517 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d344d-6b60-44b3-9144-41f2286615db service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:40.813795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d344d-6b60-44b3-9144-41f2286615db service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:40.814066 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d344d-6b60-44b3-9144-41f2286615db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:40.822595 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d344d-6b60-44b3-9144-41f2286615db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:40.824053 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d344d-6b60-44b3-9144-41f2286615db service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:40.833612 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 539/1060] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 16:58:43.227033 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c192fdb-1cb7-48a9-8b79-5b00cab88060 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:43.227542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c192fdb-1cb7-48a9-8b79-5b00cab88060 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:43.227542 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c192fdb-1cb7-48a9-8b79-5b00cab88060 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:43.228929 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 522/1061] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:43.234220 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bc527-9b9b-448f-9735-5207cbfca7dd None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:43.234656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bc527-9b9b-448f-9735-5207cbfca7dd None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:43.234782 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7bc527-9b9b-448f-9735-5207cbfca7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:43.252802 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-7b7bc527-9b9b-448f-9735-5207cbfca7dd None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:43.254022 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-7b7bc527-9b9b-448f-9735-5207cbfca7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:43.262308 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 540/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:58:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:43.300837 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c192fdb-1cb7-48a9-8b79-5b00cab88060 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:43.311156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c192fdb-1cb7-48a9-8b79-5b00cab88060 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:43.314639 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeee2c2-2e21-45d3-a55d-e59bb49d3cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:43.315261 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeee2c2-2e21-45d3-a55d-e59bb49d3cfd service neutron] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:43.315539 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeee2c2-2e21-45d3-a55d-e59bb49d3cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:43.315844 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeee2c2-2e21-45d3-a55d-e59bb49d3cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:43.326030 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeee2c2-2e21-45d3-a55d-e59bb49d3cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:43.327452 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeee2c2-2e21-45d3-a55d-e59bb49d3cfd service neutron] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:43.338846 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 523/1063] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:45.907611 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1cddf-2126-4571-b3ef-18d1f076f4e4 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:45.908170 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1cddf-2126-4571-b3ef-18d1f076f4e4 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:45.908261 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1cddf-2126-4571-b3ef-18d1f076f4e4 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:45.909618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 541/1064] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:45.916109 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e3221-6e29-4170-8a08-9b5fed95a51d None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:45.916524 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e3221-6e29-4170-8a08-9b5fed95a51d None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:45.916711 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e3221-6e29-4170-8a08-9b5fed95a51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:45.933866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-974e3221-6e29-4170-8a08-9b5fed95a51d None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:45.935048 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-974e3221-6e29-4170-8a08-9b5fed95a51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:45.942764 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 524/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:58:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:45.982067 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1cddf-2126-4571-b3ef-18d1f076f4e4 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:45.992545 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1cddf-2126-4571-b3ef-18d1f076f4e4 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:45.995994 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaaeb7d-0cda-4e37-9e36-7f61aa18793f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:45.996622 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaeb7d-0cda-4e37-9e36-7f61aa18793f service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:45.996929 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaeb7d-0cda-4e37-9e36-7f61aa18793f service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:45.997201 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaeb7d-0cda-4e37-9e36-7f61aa18793f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:46.006015 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaaeb7d-0cda-4e37-9e36-7f61aa18793f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:46.007440 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaaeb7d-0cda-4e37-9e36-7f61aa18793f service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:46.017057 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 542/1066] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:48.397049 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f50428-eb34-4320-81c3-c44f0621559f None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:48.397592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f50428-eb34-4320-81c3-c44f0621559f None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:48.397592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f50428-eb34-4320-81c3-c44f0621559f None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:48.398943 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 525/1067] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:58:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:48.404461 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0ef4b-fa2a-4597-a75e-6da14c2d397b None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:48.404888 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0ef4b-fa2a-4597-a75e-6da14c2d397b None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:48.404993 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0ef4b-fa2a-4597-a75e-6da14c2d397b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:48.421958 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-8ee0ef4b-fa2a-4597-a75e-6da14c2d397b None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:48.423136 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-8ee0ef4b-fa2a-4597-a75e-6da14c2d397b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:48.430792 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 543/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:58:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:48.477870 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f50428-eb34-4320-81c3-c44f0621559f None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:48.488227 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f50428-eb34-4320-81c3-c44f0621559f None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:48.491836 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a85231-a942-4b17-86ec-ddf6597b6e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:48.492499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a85231-a942-4b17-86ec-ddf6597b6e8f service neutron] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:48.492781 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a85231-a942-4b17-86ec-ddf6597b6e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:48.493057 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a85231-a942-4b17-86ec-ddf6597b6e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:48.503085 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a85231-a942-4b17-86ec-ddf6597b6e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:48.504544 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a85231-a942-4b17-86ec-ddf6597b6e8f service neutron] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:48.514775 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 526/1069] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:50.935237 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bc4a6-660f-47bb-ae51-33eb81e3de86 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:50.935731 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bc4a6-660f-47bb-ae51-33eb81e3de86 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:50.935828 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bc4a6-660f-47bb-ae51-33eb81e3de86 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:50.937195 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 544/1070] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:50.942608 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc784e-15ad-4e51-b500-6077ec6138d6 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:50.943012 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc784e-15ad-4e51-b500-6077ec6138d6 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:50.943170 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc784e-15ad-4e51-b500-6077ec6138d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:50.960911 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-e1dc784e-15ad-4e51-b500-6077ec6138d6 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:50.962128 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-e1dc784e-15ad-4e51-b500-6077ec6138d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:50.974289 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 527/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:58:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:51.012194 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bc4a6-660f-47bb-ae51-33eb81e3de86 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:51.023096 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bc4a6-660f-47bb-ae51-33eb81e3de86 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:51.026541 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc549557-e06d-4df4-a700-ce29dd840f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:51.027163 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc549557-e06d-4df4-a700-ce29dd840f41 service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:51.027439 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc549557-e06d-4df4-a700-ce29dd840f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:51.027748 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc549557-e06d-4df4-a700-ce29dd840f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:51.036834 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc549557-e06d-4df4-a700-ce29dd840f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:51.038277 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc549557-e06d-4df4-a700-ce29dd840f41 service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:51.047171 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 545/1072] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:53.342891 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8b5e1-db1e-417d-b911-3730f372c8c4 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:53.343449 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8b5e1-db1e-417d-b911-3730f372c8c4 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:53.343449 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8b5e1-db1e-417d-b911-3730f372c8c4 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:53.344834 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 528/1073] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:53.350875 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a7b68-7457-474e-b283-7d53b8cb06c0 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:53.351279 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a7b68-7457-474e-b283-7d53b8cb06c0 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:53.351418 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a7b68-7457-474e-b283-7d53b8cb06c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:53.368668 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-5a3a7b68-7457-474e-b283-7d53b8cb06c0 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:53.369841 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-5a3a7b68-7457-474e-b283-7d53b8cb06c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:53.377812 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 546/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:58:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:53.416654 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8b5e1-db1e-417d-b911-3730f372c8c4 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:53.426979 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8b5e1-db1e-417d-b911-3730f372c8c4 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:53.430417 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e4e93-de84-4b53-96f1-df0216875119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:53.431036 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e4e93-de84-4b53-96f1-df0216875119 service neutron] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:53.431314 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e4e93-de84-4b53-96f1-df0216875119 service neutron] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:53.431584 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e4e93-de84-4b53-96f1-df0216875119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:53.440205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e4e93-de84-4b53-96f1-df0216875119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:53.441616 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e4e93-de84-4b53-96f1-df0216875119 service neutron] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:53.450733 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 529/1075] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:55.758629 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941088f-521c-4579-8050-1573139dd50d None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:55.759191 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941088f-521c-4579-8050-1573139dd50d None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:55.759191 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941088f-521c-4579-8050-1573139dd50d None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:55.760589 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 547/1076] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:55.766038 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d98920-89ac-45ce-a80c-cd018d10cd64 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:55.766419 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d98920-89ac-45ce-a80c-cd018d10cd64 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:55.766603 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d98920-89ac-45ce-a80c-cd018d10cd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:55.783813 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-70d98920-89ac-45ce-a80c-cd018d10cd64 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:55.785033 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-70d98920-89ac-45ce-a80c-cd018d10cd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:55.792779 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 530/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:58:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:55.831224 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941088f-521c-4579-8050-1573139dd50d None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:55.841716 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941088f-521c-4579-8050-1573139dd50d None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:55.845124 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7631a7-7e31-45ab-aac3-5a70aaecfb9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:55.845752 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7631a7-7e31-45ab-aac3-5a70aaecfb9a service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:55.846027 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7631a7-7e31-45ab-aac3-5a70aaecfb9a service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:55.846296 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7631a7-7e31-45ab-aac3-5a70aaecfb9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:55.857402 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7631a7-7e31-45ab-aac3-5a70aaecfb9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:55.858915 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7631a7-7e31-45ab-aac3-5a70aaecfb9a service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:55.869018 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 548/1078] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:58:58.181020 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b4640-f9d4-449c-b3e1-9ef988fbf806 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:58.181587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b4640-f9d4-449c-b3e1-9ef988fbf806 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:58.181587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b4640-f9d4-449c-b3e1-9ef988fbf806 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:58.182831 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 531/1079] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:58:58.188223 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55496519-6bd4-4c89-8897-a705cbd3aeb2 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:58.188659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55496519-6bd4-4c89-8897-a705cbd3aeb2 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:58.188799 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55496519-6bd4-4c89-8897-a705cbd3aeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:58.205621 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-55496519-6bd4-4c89-8897-a705cbd3aeb2 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:58:58.206787 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-55496519-6bd4-4c89-8897-a705cbd3aeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:58:58.214392 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 549/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:58:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:58:58.253758 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b4640-f9d4-449c-b3e1-9ef988fbf806 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:58:58.264039 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b4640-f9d4-449c-b3e1-9ef988fbf806 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:58:58.267508 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af7d68-7825-4996-8371-5894284140c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:58:58.268165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af7d68-7825-4996-8371-5894284140c4 service neutron] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:58:58.268442 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af7d68-7825-4996-8371-5894284140c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:58:58.268710 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af7d68-7825-4996-8371-5894284140c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:58:58.277588 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af7d68-7825-4996-8371-5894284140c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:58:58.279065 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af7d68-7825-4996-8371-5894284140c4 service neutron] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:58:58.289352 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 532/1081] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:58:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:59:00.643173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c25538-c900-49b9-b68d-20e76866a443 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:00.643756 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c25538-c900-49b9-b68d-20e76866a443 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:00.643756 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c25538-c900-49b9-b68d-20e76866a443 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:00.645133 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 550/1082] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:59:00.650287 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a2620-9802-4021-b48d-66d76954ad9c None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:00.650674 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a2620-9802-4021-b48d-66d76954ad9c None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:00.650848 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a2620-9802-4021-b48d-66d76954ad9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:00.668471 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-037a2620-9802-4021-b48d-66d76954ad9c None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:59:00.669659 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-037a2620-9802-4021-b48d-66d76954ad9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:59:00.677943 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 533/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:59:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:59:00.714263 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c25538-c900-49b9-b68d-20e76866a443 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:59:00.725218 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c25538-c900-49b9-b68d-20e76866a443 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:59:00.728924 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312948e-08b7-4fc3-bce4-73c47b59ae40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:59:00.729550 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312948e-08b7-4fc3-bce4-73c47b59ae40 service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:00.729827 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312948e-08b7-4fc3-bce4-73c47b59ae40 service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:00.730097 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312948e-08b7-4fc3-bce4-73c47b59ae40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:00.738568 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312948e-08b7-4fc3-bce4-73c47b59ae40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:59:00.740042 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312948e-08b7-4fc3-bce4-73c47b59ae40 service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:59:00.749034 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 551/1084] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:59:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:59:03.039834 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e4e3b-5c41-4447-9118-457510c4795f None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:03.040390 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e4e3b-5c41-4447-9118-457510c4795f None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:03.040390 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e4e3b-5c41-4447-9118-457510c4795f None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:03.041740 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 534/1085] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 16:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:59:03.046917 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd0244-ae93-4fa8-a7a0-6d27194de3f1 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:03.047359 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd0244-ae93-4fa8-a7a0-6d27194de3f1 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:03.047465 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd0244-ae93-4fa8-a7a0-6d27194de3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:03.065059 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-54dd0244-ae93-4fa8-a7a0-6d27194de3f1 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:59:03.066240 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-54dd0244-ae93-4fa8-a7a0-6d27194de3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:59:03.074583 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 552/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 16:59:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:59:03.111614 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e4e3b-5c41-4447-9118-457510c4795f None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:59:03.122727 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e4e3b-5c41-4447-9118-457510c4795f None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:59:03.126182 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfaeff-4760-4a72-b98b-39a0b8eeb4a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:59:03.126806 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfaeff-4760-4a72-b98b-39a0b8eeb4a2 service neutron] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:03.127089 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfaeff-4760-4a72-b98b-39a0b8eeb4a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:03.127368 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfaeff-4760-4a72-b98b-39a0b8eeb4a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:03.136695 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfaeff-4760-4a72-b98b-39a0b8eeb4a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:59:03.138131 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfaeff-4760-4a72-b98b-39a0b8eeb4a2 service neutron] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:59:03.147451 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 535/1087] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:59:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:59:36.955448 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff2cc0-19a1-46e2-bbc0-ce999689ee40 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:36.956055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff2cc0-19a1-46e2-bbc0-ce999689ee40 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:36.956055 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff2cc0-19a1-46e2-bbc0-ce999689ee40 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:36.957939 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 553/1088] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:59:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:59:36.963205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bd0bf-4223-4e7a-a8a2-fe9f68e5d283 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:36.963597 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bd0bf-4223-4e7a-a8a2-fe9f68e5d283 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:36.963802 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bd0bf-4223-4e7a-a8a2-fe9f68e5d283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:36.982748 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-981bd0bf-4223-4e7a-a8a2-fe9f68e5d283 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:59:36.984072 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-981bd0bf-4223-4e7a-a8a2-fe9f68e5d283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:59:36.992419 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 536/1089] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:59:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 16:59:37.044507 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb716c7-bb6c-4740-8c81-ed6e120a3576 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:37.044801 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb716c7-bb6c-4740-8c81-ed6e120a3576 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:37.045079 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb716c7-bb6c-4740-8c81-ed6e120a3576 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:37.046445 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 554/1090] 10.222.0.64 () {54 vars in 962 bytes} [Thu May 12 16:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:59:37.051488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65873db8-7d95-4e45-b5ad-8835d084dd1c None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:37.051817 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65873db8-7d95-4e45-b5ad-8835d084dd1c None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:37.052100 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65873db8-7d95-4e45-b5ad-8835d084dd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:37.069490 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-65873db8-7d95-4e45-b5ad-8835d084dd1c None None] MFA Rules not processed for user `deb66d4bda564438852a38a4a4116ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:59:37.070668 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-65873db8-7d95-4e45-b5ad-8835d084dd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:59:37.076956 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 537/1091] 10.222.0.64 () {58 vars in 1059 bytes} [Thu May 12 16:59:37 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:59:37.084593 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb716c7-bb6c-4740-8c81-ed6e120a3576 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:59:37.094939 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb716c7-bb6c-4740-8c81-ed6e120a3576 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:59:37.099257 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcebd5-3382-454e-a873-d57e4850fbf5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deb66d4bda564438852a38a4a4116ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:59:37.099915 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcebd5-3382-454e-a873-d57e4850fbf5 service glance] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:37.100197 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcebd5-3382-454e-a873-d57e4850fbf5 service glance] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:37.100469 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcebd5-3382-454e-a873-d57e4850fbf5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:37.109403 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcebd5-3382-454e-a873-d57e4850fbf5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:59:37.110876 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcebd5-3382-454e-a873-d57e4850fbf5 service glance] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:59:37.120221 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 555/1092] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:59:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 16:59:39.563983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f03ec-6494-4406-a5b9-50b142bc55cb None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:39.564545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f03ec-6494-4406-a5b9-50b142bc55cb None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:39.564545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f03ec-6494-4406-a5b9-50b142bc55cb None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:39.565910 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 538/1093] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:59:39.571844 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f086761-24a9-4da5-85c3-900574a0855a None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:39.572290 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f086761-24a9-4da5-85c3-900574a0855a None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:39.572399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f086761-24a9-4da5-85c3-900574a0855a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:39.590663 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-5f086761-24a9-4da5-85c3-900574a0855a None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:59:39.591879 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-5f086761-24a9-4da5-85c3-900574a0855a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:59:39.599475 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 556/1094] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:59:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:59:39.623562 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f03ec-6494-4406-a5b9-50b142bc55cb None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:59:39.636259 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f03ec-6494-4406-a5b9-50b142bc55cb None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:59:39.640594 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90949868-cd08-41f3-b49f-ab765933a162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:59:39.641222 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90949868-cd08-41f3-b49f-ab765933a162 admin admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:39.641499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90949868-cd08-41f3-b49f-ab765933a162 admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:39.641771 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90949868-cd08-41f3-b49f-ab765933a162 admin admin] PATH_INFO: `/v3/projects` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:39.642483 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90949868-cd08-41f3-b49f-ab765933a162 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:59:39.644876 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: WARNING py.warnings [None req-90949868-cd08-41f3-b49f-ab765933a162 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 16:59:39.644876 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: warnings.warn(msg) May 12 16:59:39.644876 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: May 12 16:59:39.645993 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90949868-cd08-41f3-b49f-ab765933a162 admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:59:39.663216 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 539/1095] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 12 16:59:39 2022] GET /identity/v3/projects => generated 1606 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 16:59:41.971374 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66b62a-49f9-49a5-8b9e-73e412d7b970 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:41.971953 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66b62a-49f9-49a5-8b9e-73e412d7b970 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:41.971953 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66b62a-49f9-49a5-8b9e-73e412d7b970 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:41.973983 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 557/1096] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:59:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:59:41.979401 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba1b0e-9d44-461f-ade0-1c0aaac29ca5 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:41.979834 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba1b0e-9d44-461f-ade0-1c0aaac29ca5 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:41.980004 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba1b0e-9d44-461f-ade0-1c0aaac29ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:41.997533 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-beba1b0e-9d44-461f-ade0-1c0aaac29ca5 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:59:41.998722 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-beba1b0e-9d44-461f-ade0-1c0aaac29ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:59:42.006582 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 540/1097] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:59:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:59:42.049647 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66b62a-49f9-49a5-8b9e-73e412d7b970 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:59:42.062794 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66b62a-49f9-49a5-8b9e-73e412d7b970 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:59:42.067604 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5e266-512e-4bb0-a9ae-10fd9a0d5bec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:59:42.068265 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5e266-512e-4bb0-a9ae-10fd9a0d5bec service nova] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:42.068547 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5e266-512e-4bb0-a9ae-10fd9a0d5bec service nova] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:42.068821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5e266-512e-4bb0-a9ae-10fd9a0d5bec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:42.076774 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5e266-512e-4bb0-a9ae-10fd9a0d5bec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:59:42.078360 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5e266-512e-4bb0-a9ae-10fd9a0d5bec service nova] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:59:42.088185 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 558/1098] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:59:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:59:44.536450 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24345c97-5855-40ee-82de-b688aecfc5a7 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:44.536996 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24345c97-5855-40ee-82de-b688aecfc5a7 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:44.536996 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24345c97-5855-40ee-82de-b688aecfc5a7 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:44.538349 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 541/1099] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:59:44.543492 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c335bd-b759-4893-9f0d-d200126a1aab None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:44.543917 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c335bd-b759-4893-9f0d-d200126a1aab None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:44.544073 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c335bd-b759-4893-9f0d-d200126a1aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:44.561539 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-98c335bd-b759-4893-9f0d-d200126a1aab None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:59:44.562693 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-98c335bd-b759-4893-9f0d-d200126a1aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:59:44.571269 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 559/1100] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:59:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:59:44.608082 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24345c97-5855-40ee-82de-b688aecfc5a7 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:59:44.619030 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24345c97-5855-40ee-82de-b688aecfc5a7 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:59:44.623128 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56676364-d532-4877-abb4-e45e251420c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:59:44.623836 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56676364-d532-4877-abb4-e45e251420c5 service neutron] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:44.624123 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56676364-d532-4877-abb4-e45e251420c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:44.624380 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56676364-d532-4877-abb4-e45e251420c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:44.633933 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56676364-d532-4877-abb4-e45e251420c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:59:44.635358 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56676364-d532-4877-abb4-e45e251420c5 service neutron] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:59:44.644529 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 542/1101] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:59:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:59:47.011017 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd607733-403c-4543-a539-ef6d3a934820 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:47.011578 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd607733-403c-4543-a539-ef6d3a934820 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:47.011712 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd607733-403c-4543-a539-ef6d3a934820 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:47.013054 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 560/1102] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:59:47.018166 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef1239-c3df-4023-ac62-b8f0f034dd82 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:47.018554 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef1239-c3df-4023-ac62-b8f0f034dd82 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:47.018722 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef1239-c3df-4023-ac62-b8f0f034dd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:47.037921 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-c9ef1239-c3df-4023-ac62-b8f0f034dd82 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:59:47.039098 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-c9ef1239-c3df-4023-ac62-b8f0f034dd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:59:47.046707 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 543/1103] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:59:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:59:47.085089 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd607733-403c-4543-a539-ef6d3a934820 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:59:47.095595 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd607733-403c-4543-a539-ef6d3a934820 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:59:47.099077 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790137b-8ce5-44d7-930d-5a70cfd030f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:59:47.099742 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790137b-8ce5-44d7-930d-5a70cfd030f4 service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:47.100027 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790137b-8ce5-44d7-930d-5a70cfd030f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:47.100304 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790137b-8ce5-44d7-930d-5a70cfd030f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:47.109158 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790137b-8ce5-44d7-930d-5a70cfd030f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:59:47.110590 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790137b-8ce5-44d7-930d-5a70cfd030f4 service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:59:47.119996 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 561/1104] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:59:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:59:49.555700 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef07a52-17a2-4c96-8542-99e873eb739c None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:49.556284 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef07a52-17a2-4c96-8542-99e873eb739c None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:49.556284 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef07a52-17a2-4c96-8542-99e873eb739c None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:49.557610 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 544/1105] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 16:59:49.562707 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796f829-4241-4d1f-a241-e8addeb15f9d None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:49.563082 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796f829-4241-4d1f-a241-e8addeb15f9d None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:49.563272 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796f829-4241-4d1f-a241-e8addeb15f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:49.580971 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-2796f829-4241-4d1f-a241-e8addeb15f9d None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:59:49.582188 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-2796f829-4241-4d1f-a241-e8addeb15f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:59:49.590490 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 562/1106] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:59:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:59:49.631211 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef07a52-17a2-4c96-8542-99e873eb739c None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:59:49.641488 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef07a52-17a2-4c96-8542-99e873eb739c None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:59:49.644984 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6da3e2-d765-44c5-8fe1-b826cc931713 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:59:49.645609 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6da3e2-d765-44c5-8fe1-b826cc931713 service neutron] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:49.645886 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6da3e2-d765-44c5-8fe1-b826cc931713 service neutron] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:49.646155 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6da3e2-d765-44c5-8fe1-b826cc931713 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:49.654663 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6da3e2-d765-44c5-8fe1-b826cc931713 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:59:49.656122 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6da3e2-d765-44c5-8fe1-b826cc931713 service neutron] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:59:49.665275 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 545/1107] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:59:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 16:59:52.115107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64a9c3-03c6-42f7-b8cc-6ea0f8a444b4 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:52.115661 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64a9c3-03c6-42f7-b8cc-6ea0f8a444b4 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:52.115759 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64a9c3-03c6-42f7-b8cc-6ea0f8a444b4 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:52.117122 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 563/1108] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 12 16:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 16:59:52.122483 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592523d9-8cda-4ad9-8d96-92402217d715 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:52.122932 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592523d9-8cda-4ad9-8d96-92402217d715 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:52.123031 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592523d9-8cda-4ad9-8d96-92402217d715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:52.140292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-592523d9-8cda-4ad9-8d96-92402217d715 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 16:59:52.141515 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-592523d9-8cda-4ad9-8d96-92402217d715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 16:59:52.149274 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 546/1109] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 12 16:59:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 16:59:52.187946 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64a9c3-03c6-42f7-b8cc-6ea0f8a444b4 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 16:59:52.198220 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64a9c3-03c6-42f7-b8cc-6ea0f8a444b4 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 16:59:52.201620 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eb9bf-ff89-4f58-9200-39d8a4848efb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 16:59:52.202242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eb9bf-ff89-4f58-9200-39d8a4848efb service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 16:59:52.202518 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eb9bf-ff89-4f58-9200-39d8a4848efb service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 16:59:52.202788 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eb9bf-ff89-4f58-9200-39d8a4848efb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 16:59:52.211277 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659eb9bf-ff89-4f58-9200-39d8a4848efb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 16:59:52.212736 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659eb9bf-ff89-4f58-9200-39d8a4848efb service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 16:59:52.221644 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 564/1110] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 16:59:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:01:19.996374 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0ccaf-5a96-4b17-b218-1da10c349805 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:01:19.997023 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0ccaf-5a96-4b17-b218-1da10c349805 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:01:19.997023 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0ccaf-5a96-4b17-b218-1da10c349805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:01:20.014758 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-d7c0ccaf-5a96-4b17-b218-1da10c349805 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:01:20.016104 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-d7c0ccaf-5a96-4b17-b218-1da10c349805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:01:20.024672 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 547/1111] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:01:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:01:20.033697 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef02d6-8e18-47ae-ba81-dd6c1ffb5f25 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:01:20.034202 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef02d6-8e18-47ae-ba81-dd6c1ffb5f25 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:01:20.034307 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef02d6-8e18-47ae-ba81-dd6c1ffb5f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:01:20.052361 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-68ef02d6-8e18-47ae-ba81-dd6c1ffb5f25 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:01:20.053562 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-68ef02d6-8e18-47ae-ba81-dd6c1ffb5f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:01:20.061368 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 565/1112] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:01:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:01:20.066400 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0ccaf-5a96-4b17-b218-1da10c349805 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:01:20.076113 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0ccaf-5a96-4b17-b218-1da10c349805 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:01:20.081444 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff64ee6-da52-45e4-bb40-5cbb1d4721c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:01:20.082090 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff64ee6-da52-45e4-bb40-5cbb1d4721c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:01:20.082404 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff64ee6-da52-45e4-bb40-5cbb1d4721c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:01:20.082681 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff64ee6-da52-45e4-bb40-5cbb1d4721c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:01:20.083400 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff64ee6-da52-45e4-bb40-5cbb1d4721c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:01:20.083742 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff64ee6-da52-45e4-bb40-5cbb1d4721c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:01:20.084747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: WARNING py.warnings [None req-dff64ee6-da52-45e4-bb40-5cbb1d4721c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:01:20.084747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: warnings.warn(msg) May 12 17:01:20.084747 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: May 12 17:01:20.085622 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff64ee6-da52-45e4-bb40-5cbb1d4721c5 admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:01:20.096644 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 548/1113] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 12 17:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:01:20.105006 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef02d6-8e18-47ae-ba81-dd6c1ffb5f25 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:01:20.113979 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef02d6-8e18-47ae-ba81-dd6c1ffb5f25 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:01:20.118604 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ca0dd-cf00-469b-a43c-8715a80198e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:01:20.119246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ca0dd-cf00-469b-a43c-8715a80198e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:01:20.119529 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ca0dd-cf00-469b-a43c-8715a80198e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:01:20.119838 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ca0dd-cf00-469b-a43c-8715a80198e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:01:20.120533 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ca0dd-cf00-469b-a43c-8715a80198e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:01:20.122336 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: WARNING py.warnings [None req-cf6ca0dd-cf00-469b-a43c-8715a80198e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:01:20.122336 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: warnings.warn(msg) May 12 17:01:20.122336 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: May 12 17:01:20.123522 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ca0dd-cf00-469b-a43c-8715a80198e6 admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:01:20.148386 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 566/1114] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 12 17:01:20 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:01:20.152463 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff64ee6-da52-45e4-bb40-5cbb1d4721c5 admin admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:01:20.162209 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff64ee6-da52-45e4-bb40-5cbb1d4721c5 admin admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:01:20.219297 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144943b9-222e-4afb-abe1-a3ba2546be2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:01:20.220001 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144943b9-222e-4afb-abe1-a3ba2546be2d admin admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:01:20.220284 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144943b9-222e-4afb-abe1-a3ba2546be2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:01:20.220558 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144943b9-222e-4afb-abe1-a3ba2546be2d admin admin] PATH_INFO: `/v3/users` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:01:20.221289 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144943b9-222e-4afb-abe1-a3ba2546be2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:01:20.222251 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: WARNING py.warnings [None req-144943b9-222e-4afb-abe1-a3ba2546be2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:01:20.222251 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: warnings.warn(msg) May 12 17:01:20.222251 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: May 12 17:01:20.223461 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144943b9-222e-4afb-abe1-a3ba2546be2d admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:01:20.242816 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 549/1115] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 12 17:01:20 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:01:20.246964 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ca0dd-cf00-469b-a43c-8715a80198e6 admin admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:01:20.257467 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ca0dd-cf00-469b-a43c-8715a80198e6 admin admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:01:20.262010 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675887d-de62-413c-bfe8-d37018f2173e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:01:20.262658 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675887d-de62-413c-bfe8-d37018f2173e admin admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:01:20.262941 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675887d-de62-413c-bfe8-d37018f2173e admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:01:20.263231 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675887d-de62-413c-bfe8-d37018f2173e admin admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:01:20.263981 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675887d-de62-413c-bfe8-d37018f2173e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:01:20.264993 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: WARNING py.warnings [None req-d675887d-de62-413c-bfe8-d37018f2173e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:01:20.264993 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: warnings.warn(msg) May 12 17:01:20.264993 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: May 12 17:01:20.265871 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675887d-de62-413c-bfe8-d37018f2173e admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:01:20.278596 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 567/1116] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 12 17:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:01:20.282258 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144943b9-222e-4afb-abe1-a3ba2546be2d admin admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:01:20.291652 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144943b9-222e-4afb-abe1-a3ba2546be2d admin admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:01:20.296143 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d44ee-220d-4d9a-9d2e-c4d9da318c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:01:20.296785 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d44ee-220d-4d9a-9d2e-c4d9da318c53 admin admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:01:20.297062 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d44ee-220d-4d9a-9d2e-c4d9da318c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:01:20.297825 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d44ee-220d-4d9a-9d2e-c4d9da318c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:01:20.298527 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d44ee-220d-4d9a-9d2e-c4d9da318c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:01:20.299519 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: WARNING py.warnings [None req-1f4d44ee-220d-4d9a-9d2e-c4d9da318c53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:01:20.299519 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: warnings.warn(msg) May 12 17:01:20.299519 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: May 12 17:01:20.300411 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d44ee-220d-4d9a-9d2e-c4d9da318c53 admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:01:20.313718 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 550/1117] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 12 17:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:01:20.317733 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675887d-de62-413c-bfe8-d37018f2173e admin admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:01:20.327345 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675887d-de62-413c-bfe8-d37018f2173e admin admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:01:20.332426 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8d8f8-f298-42c5-9f19-304e9a9719dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:01:20.333295 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8d8f8-f298-42c5-9f19-304e9a9719dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:01:20.333575 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8d8f8-f298-42c5-9f19-304e9a9719dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:01:20.333850 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8d8f8-f298-42c5-9f19-304e9a9719dd admin admin] PATH_INFO: `/v3/projects/f7d7c872a684425783e8b310489a3650/users/8fe6c4f59ace40c3bebd7461544b5f23/roles/0474b158b4bc4046ac169d53fff04721` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:01:20.347680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8d8f8-f298-42c5-9f19-304e9a9719dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d7c872a684425783e8b310489a3650, user_id=8fe6c4f59ace40c3bebd7461544b5f23, role_id=0474b158b4bc4046ac169d53fff04721)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:01:20.348717 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: WARNING py.warnings [None req-fcb8d8f8-f298-42c5-9f19-304e9a9719dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:01:20.348717 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: warnings.warn(msg) May 12 17:01:20.348717 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: May 12 17:01:20.350656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8d8f8-f298-42c5-9f19-304e9a9719dd admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:01:20.364600 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 568/1118] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 12 17:01:20 2022] PUT /identity/v3/projects/f7d7c872a684425783e8b310489a3650/users/8fe6c4f59ace40c3bebd7461544b5f23/roles/0474b158b4bc4046ac169d53fff04721 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:01:20.376480 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eccfe-d94d-47bb-a899-f54b9bc52959 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:01:20.376894 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eccfe-d94d-47bb-a899-f54b9bc52959 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:01:20.377174 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eccfe-d94d-47bb-a899-f54b9bc52959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:01:20.401914 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-7c1eccfe-d94d-47bb-a899-f54b9bc52959 None None] MFA Rules not processed for user `8fe6c4f59ace40c3bebd7461544b5f23`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:01:20.403101 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-7c1eccfe-d94d-47bb-a899-f54b9bc52959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:01:20.462903 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 551/1119] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:01:20 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:01:20.475763 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de821d-1391-4672-83c7-16982e5f6901 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:01:20.476047 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de821d-1391-4672-83c7-16982e5f6901 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:01:20.476317 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de821d-1391-4672-83c7-16982e5f6901 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:01:20.477681 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 569/1120] 10.222.0.64 () {54 vars in 963 bytes} [Thu May 12 17:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:01:20.482911 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717b9cf-b990-45e3-981b-e22b409547e5 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:01:20.483201 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717b9cf-b990-45e3-981b-e22b409547e5 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:01:20.483477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717b9cf-b990-45e3-981b-e22b409547e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:01:20.502374 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-0717b9cf-b990-45e3-981b-e22b409547e5 None None] MFA Rules not processed for user `83541095ea5646038feef0764f0473c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:01:20.503535 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-0717b9cf-b990-45e3-981b-e22b409547e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:01:20.551278 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 552/1121] 10.222.0.64 () {58 vars in 1060 bytes} [Thu May 12 17:01:20 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:01:20.558706 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de821d-1391-4672-83c7-16982e5f6901 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:01:20.569742 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de821d-1391-4672-83c7-16982e5f6901 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:01:20.573290 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6ea2e-6cb5-4e49-ad86-a769ec086c56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83541095ea5646038feef0764f0473c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:01:20.573916 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6ea2e-6cb5-4e49-ad86-a769ec086c56 service cinder] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:01:20.574253 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6ea2e-6cb5-4e49-ad86-a769ec086c56 service cinder] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:01:20.574531 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6ea2e-6cb5-4e49-ad86-a769ec086c56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:01:20.582656 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6ea2e-6cb5-4e49-ad86-a769ec086c56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:01:20.584135 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6ea2e-6cb5-4e49-ad86-a769ec086c56 service cinder] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:01:20.592615 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 570/1122] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:01:20 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:01:20.631892 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc551e-9abb-4cb0-8c5b-8e8261be5317 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:01:20.632205 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc551e-9abb-4cb0-8c5b-8e8261be5317 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:01:20.632580 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc551e-9abb-4cb0-8c5b-8e8261be5317 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:01:20.633909 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 553/1123] 10.222.0.64 () {52 vars in 829 bytes} [Thu May 12 17:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:01:20.638044 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6ea2e-6cb5-4e49-ad86-a769ec086c56 service cinder] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:01:20.696065 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6ea2e-6cb5-4e49-ad86-a769ec086c56 service cinder] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:01:20.700554 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583be082-0219-4741-b33f-53dc581caa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:01:20.701401 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583be082-0219-4741-b33f-53dc581caa72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:01:20.701680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583be082-0219-4741-b33f-53dc581caa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:01:20.701953 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583be082-0219-4741-b33f-53dc581caa72 admin admin] PATH_INFO: `/v3/users/8fe6c4f59ace40c3bebd7461544b5f23` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:01:20.703128 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583be082-0219-4741-b33f-53dc581caa72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe6c4f59ace40c3bebd7461544b5f23)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:01:20.704203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: WARNING py.warnings [None req-583be082-0219-4741-b33f-53dc581caa72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:01:20.704203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: warnings.warn(msg) May 12 17:01:20.704203 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: May 12 17:01:20.705403 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583be082-0219-4741-b33f-53dc581caa72 admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:01:20.766281 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-583be082-0219-4741-b33f-53dc581caa72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe6c4f59ace40c3bebd7461544b5f23'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:01:20.775276 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-583be082-0219-4741-b33f-53dc581caa72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe6c4f59ace40c3bebd7461544b5f23'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:01:20.792876 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-583be082-0219-4741-b33f-53dc581caa72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe6c4f59ace40c3bebd7461544b5f23'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:01:20.793530 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-583be082-0219-4741-b33f-53dc581caa72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe6c4f59ace40c3bebd7461544b5f23'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:01:20.794231 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-583be082-0219-4741-b33f-53dc581caa72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe6c4f59ace40c3bebd7461544b5f23'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:01:20.812311 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 571/1124] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 12 17:01:20 2022] DELETE /identity/v3/users/8fe6c4f59ace40c3bebd7461544b5f23 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:01:20.816726 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa21eea-202c-43ae-81a5-988d6670da0f None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:01:20.817015 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa21eea-202c-43ae-81a5-988d6670da0f None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:01:20.817292 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa21eea-202c-43ae-81a5-988d6670da0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:01:20.835355 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-5aa21eea-202c-43ae-81a5-988d6670da0f None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:01:20.836592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-5aa21eea-202c-43ae-81a5-988d6670da0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:01:20.892550 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 554/1125] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:01:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:01:20.901825 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583be082-0219-4741-b33f-53dc581caa72 admin admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:01:20.903198 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-583be082-0219-4741-b33f-53dc581caa72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:01:20.963713 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583be082-0219-4741-b33f-53dc581caa72 admin admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:01:20.967333 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584ca00-7fef-4879-88be-237b24661ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:01:20.968017 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584ca00-7fef-4879-88be-237b24661ead service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:01:20.968300 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584ca00-7fef-4879-88be-237b24661ead service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:01:20.968576 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584ca00-7fef-4879-88be-237b24661ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:01:20.978649 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584ca00-7fef-4879-88be-237b24661ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:01:20.980108 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584ca00-7fef-4879-88be-237b24661ead service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:01:20.989281 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 572/1126] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:01:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:01:21.381030 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa21eea-202c-43ae-81a5-988d6670da0f None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:01:21.382552 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-5aa21eea-202c-43ae-81a5-988d6670da0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:01:21.394968 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa21eea-202c-43ae-81a5-988d6670da0f None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:01:21.399797 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033c0af-e1c2-44b1-8aab-c1cdf4e81768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:01:21.400666 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033c0af-e1c2-44b1-8aab-c1cdf4e81768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:01:21.401417 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033c0af-e1c2-44b1-8aab-c1cdf4e81768 admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:01:21.401692 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033c0af-e1c2-44b1-8aab-c1cdf4e81768 admin admin] PATH_INFO: `/v3/projects/f7d7c872a684425783e8b310489a3650` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:01:21.402933 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033c0af-e1c2-44b1-8aab-c1cdf4e81768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7d7c872a684425783e8b310489a3650)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:01:21.404307 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: WARNING py.warnings [None req-9033c0af-e1c2-44b1-8aab-c1cdf4e81768 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:01:21.404307 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: warnings.warn(msg) May 12 17:01:21.404307 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: May 12 17:01:21.405497 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033c0af-e1c2-44b1-8aab-c1cdf4e81768 admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:01:21.467656 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-9033c0af-e1c2-44b1-8aab-c1cdf4e81768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d7c872a684425783e8b310489a3650', 'request_id': 'req-9033c0af-e1c2-44b1-8aab-c1cdf4e81768'} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:01:21.473477 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-9033c0af-e1c2-44b1-8aab-c1cdf4e81768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d7c872a684425783e8b310489a3650', 'request_id': 'req-9033c0af-e1c2-44b1-8aab-c1cdf4e81768'} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:01:21.482736 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-9033c0af-e1c2-44b1-8aab-c1cdf4e81768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d7c872a684425783e8b310489a3650', 'request_id': 'req-9033c0af-e1c2-44b1-8aab-c1cdf4e81768'} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:01:21.501067 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-9033c0af-e1c2-44b1-8aab-c1cdf4e81768 admin admin] The token cache is being invalidate because project f7d7c872a684425783e8b310489a3650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:01:21.501352 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-9033c0af-e1c2-44b1-8aab-c1cdf4e81768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:01:21.501986 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-9033c0af-e1c2-44b1-8aab-c1cdf4e81768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:01:21.503592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 555/1127] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 12 17:01:21 2022] DELETE /identity/v3/projects/f7d7c872a684425783e8b310489a3650 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:02:46.064461 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a022de-44be-4e96-9cca-63254d27313f None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:02:46.065582 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a022de-44be-4e96-9cca-63254d27313f None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:02:46.065582 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a022de-44be-4e96-9cca-63254d27313f None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:02:46.066922 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 573/1128] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 17:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:02:46.071866 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f250d83-1dcf-4b3c-9547-0ec7ea330cf0 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:02:46.072261 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f250d83-1dcf-4b3c-9547-0ec7ea330cf0 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:02:46.072429 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f250d83-1dcf-4b3c-9547-0ec7ea330cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:02:46.136462 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-7f250d83-1dcf-4b3c-9547-0ec7ea330cf0 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:02:46.137667 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-7f250d83-1dcf-4b3c-9547-0ec7ea330cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:02:46.229788 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 556/1129] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 17:02:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:02:46.400205 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a022de-44be-4e96-9cca-63254d27313f None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:02:46.401873 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-89a022de-44be-4e96-9cca-63254d27313f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:02:46.486475 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a022de-44be-4e96-9cca-63254d27313f None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:02:46.491306 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62837a-feb6-4024-85be-bdb7b3884475 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:02:46.491981 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62837a-feb6-4024-85be-bdb7b3884475 service nova] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:02:46.492260 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62837a-feb6-4024-85be-bdb7b3884475 service nova] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:02:46.492529 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62837a-feb6-4024-85be-bdb7b3884475 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:02:46.500263 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62837a-feb6-4024-85be-bdb7b3884475 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:02:46.501832 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62837a-feb6-4024-85be-bdb7b3884475 service nova] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:02:46.510808 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 574/1130] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:02:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:02:47.407221 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c87d7-11e5-42a4-af31-ba9eb246ba0d None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:02:47.407780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c87d7-11e5-42a4-af31-ba9eb246ba0d None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:02:47.407889 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c87d7-11e5-42a4-af31-ba9eb246ba0d None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:02:47.409764 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 557/1131] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 17:02:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:02:47.414511 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd714ed-212d-4004-8dc7-6292c5c62ffd None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:02:47.414918 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd714ed-212d-4004-8dc7-6292c5c62ffd None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:02:47.415074 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd714ed-212d-4004-8dc7-6292c5c62ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:02:47.432518 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-efd714ed-212d-4004-8dc7-6292c5c62ffd None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:02:47.433714 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-efd714ed-212d-4004-8dc7-6292c5c62ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:02:47.441887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 575/1132] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 17:02:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:02:47.596257 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c87d7-11e5-42a4-af31-ba9eb246ba0d None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:02:47.614416 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c87d7-11e5-42a4-af31-ba9eb246ba0d None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:02:47.619327 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35801ae7-f37c-424e-8c3a-5e80a415c34e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:02:47.620002 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35801ae7-f37c-424e-8c3a-5e80a415c34e service nova] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:02:47.620289 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35801ae7-f37c-424e-8c3a-5e80a415c34e service nova] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:02:47.620568 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35801ae7-f37c-424e-8c3a-5e80a415c34e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:02:47.628965 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35801ae7-f37c-424e-8c3a-5e80a415c34e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:02:47.630545 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35801ae7-f37c-424e-8c3a-5e80a415c34e service nova] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:02:47.640043 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 558/1133] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:02:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:02:52.669283 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e6762-2498-439d-8c24-a7d0d3e1940b None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:02:52.669838 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e6762-2498-439d-8c24-a7d0d3e1940b None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:02:52.669838 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e6762-2498-439d-8c24-a7d0d3e1940b None None] PATH_INFO: `/v3` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:02:52.671146 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 576/1134] 10.222.0.13 () {54 vars in 925 bytes} [Thu May 12 17:02:52 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 17:02:52.677455 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497a364-3a72-44b5-b9ee-ff3eda38996a None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:02:52.677860 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497a364-3a72-44b5-b9ee-ff3eda38996a None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:02:52.678004 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497a364-3a72-44b5-b9ee-ff3eda38996a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:02:52.704966 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-4497a364-3a72-44b5-b9ee-ff3eda38996a None None] MFA Rules not processed for user `8c64a6e5ef494d00817bb47cd6fd2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:02:52.706143 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-4497a364-3a72-44b5-b9ee-ff3eda38996a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:02:52.764550 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 559/1135] 10.222.0.13 () {58 vars in 1015 bytes} [Thu May 12 17:02:52 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:02:58.950927 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c665ce-8baf-4a5f-93a9-77cca38f67df None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:02:58.951388 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c665ce-8baf-4a5f-93a9-77cca38f67df None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:02:58.951495 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c665ce-8baf-4a5f-93a9-77cca38f67df None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:02:58.952903 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 577/1136] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 17:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:02:58.957784 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae200ce-f025-4983-a085-742647e9ec1f None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:02:58.958242 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae200ce-f025-4983-a085-742647e9ec1f None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:02:58.958358 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae200ce-f025-4983-a085-742647e9ec1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:02:58.976349 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-1ae200ce-f025-4983-a085-742647e9ec1f None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:02:58.977556 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-1ae200ce-f025-4983-a085-742647e9ec1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:02:58.985719 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 560/1137] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 17:02:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:02:59.140644 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c665ce-8baf-4a5f-93a9-77cca38f67df None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:02:59.154931 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c665ce-8baf-4a5f-93a9-77cca38f67df None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:02:59.160604 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af0e16-ed21-4c8a-8b80-9241a5c7be26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:02:59.161286 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af0e16-ed21-4c8a-8b80-9241a5c7be26 service nova] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:02:59.161520 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af0e16-ed21-4c8a-8b80-9241a5c7be26 service nova] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:02:59.161793 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af0e16-ed21-4c8a-8b80-9241a5c7be26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:02:59.169963 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af0e16-ed21-4c8a-8b80-9241a5c7be26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:02:59.171541 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af0e16-ed21-4c8a-8b80-9241a5c7be26 service nova] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:02:59.180721 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 578/1138] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:02:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:03:00.071750 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233005df-53c8-48cc-a7cb-b7006206af0e None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:00.072345 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233005df-53c8-48cc-a7cb-b7006206af0e None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:00.072345 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233005df-53c8-48cc-a7cb-b7006206af0e None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:00.073850 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 561/1139] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 17:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:03:00.078809 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f9d50-e23e-4662-b2f1-61fac1d0ee27 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:00.079235 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f9d50-e23e-4662-b2f1-61fac1d0ee27 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:00.079430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f9d50-e23e-4662-b2f1-61fac1d0ee27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:00.096740 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-6d3f9d50-e23e-4662-b2f1-61fac1d0ee27 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:03:00.097957 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-6d3f9d50-e23e-4662-b2f1-61fac1d0ee27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:03:00.105867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 579/1140] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 17:03:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:03:00.260869 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233005df-53c8-48cc-a7cb-b7006206af0e None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:03:00.285407 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233005df-53c8-48cc-a7cb-b7006206af0e None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:03:00.290210 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55641cb2-612c-40a3-b9d4-102fb0f1d4eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:03:00.290847 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55641cb2-612c-40a3-b9d4-102fb0f1d4eb service nova] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:00.291139 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55641cb2-612c-40a3-b9d4-102fb0f1d4eb service nova] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:00.291395 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55641cb2-612c-40a3-b9d4-102fb0f1d4eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:00.299981 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55641cb2-612c-40a3-b9d4-102fb0f1d4eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:03:00.301587 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55641cb2-612c-40a3-b9d4-102fb0f1d4eb service nova] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:03:00.316337 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 562/1141] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:03:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:03:02.966420 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ce124-5891-4919-9e15-093992b38aff None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:02.966887 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ce124-5891-4919-9e15-093992b38aff None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:02.967004 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ce124-5891-4919-9e15-093992b38aff None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:02.968379 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 580/1142] 10.222.0.64 () {54 vars in 960 bytes} [Thu May 12 17:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:03:02.973550 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9dafd-d77c-47fa-9f0e-7dc39df22e99 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:02.973972 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9dafd-d77c-47fa-9f0e-7dc39df22e99 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:02.974078 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9dafd-d77c-47fa-9f0e-7dc39df22e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:02.994005 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-03a9dafd-d77c-47fa-9f0e-7dc39df22e99 None None] MFA Rules not processed for user `8c64a6e5ef494d00817bb47cd6fd2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:03:02.995258 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-03a9dafd-d77c-47fa-9f0e-7dc39df22e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:03:03.004497 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 563/1143] 10.222.0.64 () {58 vars in 1057 bytes} [Thu May 12 17:03:02 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:03:03.011604 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ce124-5891-4919-9e15-093992b38aff None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:03:03.024294 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ce124-5891-4919-9e15-093992b38aff None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:03:03.029012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca4ea8-4423-4fee-a011-b9ca068e5787 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c64a6e5ef494d00817bb47cd6fd2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:03:03.029632 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca4ea8-4423-4fee-a011-b9ca068e5787 service placement] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:03.029920 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca4ea8-4423-4fee-a011-b9ca068e5787 service placement] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:03.030189 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca4ea8-4423-4fee-a011-b9ca068e5787 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:03.038011 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca4ea8-4423-4fee-a011-b9ca068e5787 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:03:03.039578 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca4ea8-4423-4fee-a011-b9ca068e5787 service placement] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:03:03.048776 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 581/1144] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:03:03 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:03:11.625635 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b967373-1128-402c-85f6-1d0aaf9a704a None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:11.626285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b967373-1128-402c-85f6-1d0aaf9a704a None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:11.626285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b967373-1128-402c-85f6-1d0aaf9a704a None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:11.627612 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 564/1145] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 17:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:03:11.632900 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb78d4-74a7-4e8e-bbeb-783b866c1485 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:11.633299 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb78d4-74a7-4e8e-bbeb-783b866c1485 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:11.633459 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb78d4-74a7-4e8e-bbeb-783b866c1485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:11.651359 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-effb78d4-74a7-4e8e-bbeb-783b866c1485 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:03:11.652578 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-effb78d4-74a7-4e8e-bbeb-783b866c1485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:03:11.660340 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 582/1146] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 17:03:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:03:11.817659 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b967373-1128-402c-85f6-1d0aaf9a704a None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:03:11.830822 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b967373-1128-402c-85f6-1d0aaf9a704a None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:03:11.835723 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce93112-0deb-494b-9203-1dd014cf37ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:03:11.836357 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce93112-0deb-494b-9203-1dd014cf37ab service nova] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:11.836639 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce93112-0deb-494b-9203-1dd014cf37ab service nova] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:11.836922 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce93112-0deb-494b-9203-1dd014cf37ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:11.844779 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce93112-0deb-494b-9203-1dd014cf37ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:03:11.846374 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce93112-0deb-494b-9203-1dd014cf37ab service nova] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:03:11.855743 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 565/1147] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:03:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:03:12.749654 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c298625-0914-4405-b0da-d728d8188306 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:12.750160 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c298625-0914-4405-b0da-d728d8188306 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:12.750160 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c298625-0914-4405-b0da-d728d8188306 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:12.751502 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 583/1148] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 17:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:03:12.756441 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d6640-a604-4cb5-8902-96a22c547bcd None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:12.756871 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d6640-a604-4cb5-8902-96a22c547bcd None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:12.756988 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d6640-a604-4cb5-8902-96a22c547bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:12.774893 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-6c3d6640-a604-4cb5-8902-96a22c547bcd None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:03:12.776132 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-6c3d6640-a604-4cb5-8902-96a22c547bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:03:12.783853 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 566/1149] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 17:03:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:03:12.937481 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c298625-0914-4405-b0da-d728d8188306 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:03:12.951088 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c298625-0914-4405-b0da-d728d8188306 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:03:12.955946 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a186eda-c7e5-4f81-b705-1b956b43bb03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:03:12.957139 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a186eda-c7e5-4f81-b705-1b956b43bb03 service nova] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:12.957422 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a186eda-c7e5-4f81-b705-1b956b43bb03 service nova] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:12.957700 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a186eda-c7e5-4f81-b705-1b956b43bb03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:12.965478 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a186eda-c7e5-4f81-b705-1b956b43bb03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:03:12.967059 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a186eda-c7e5-4f81-b705-1b956b43bb03 service nova] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:03:12.976092 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 584/1150] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:03:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:03:17.175841 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea47e4a-9253-4849-9327-8c9990278a04 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:17.176480 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea47e4a-9253-4849-9327-8c9990278a04 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:17.176480 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea47e4a-9253-4849-9327-8c9990278a04 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:17.177661 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 567/1151] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 17:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:03:17.182947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d919f-e114-415d-a708-e62b65749f15 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:17.183399 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d919f-e114-415d-a708-e62b65749f15 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:17.183509 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d919f-e114-415d-a708-e62b65749f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:17.201233 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-2f1d919f-e114-415d-a708-e62b65749f15 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:03:17.202419 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-2f1d919f-e114-415d-a708-e62b65749f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:03:17.211212 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 585/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 17:03:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:03:17.247961 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea47e4a-9253-4849-9327-8c9990278a04 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:03:17.249718 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-7ea47e4a-9253-4849-9327-8c9990278a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:03:17.305105 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea47e4a-9253-4849-9327-8c9990278a04 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:03:17.308556 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa3610-7bd7-4792-bbc0-9ba15faaf494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:03:17.309188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa3610-7bd7-4792-bbc0-9ba15faaf494 service neutron] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:17.309478 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa3610-7bd7-4792-bbc0-9ba15faaf494 service neutron] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:17.309752 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa3610-7bd7-4792-bbc0-9ba15faaf494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:17.318285 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa3610-7bd7-4792-bbc0-9ba15faaf494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:03:17.319737 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa3610-7bd7-4792-bbc0-9ba15faaf494 service neutron] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:03:17.328677 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 568/1153] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:03:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:03:19.575197 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59f970-53f5-4c7b-9296-0ea77b70244b None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:19.575782 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59f970-53f5-4c7b-9296-0ea77b70244b None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:19.575782 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59f970-53f5-4c7b-9296-0ea77b70244b None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:19.577212 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 586/1154] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 17:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:03:19.582555 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f0f8b-8886-4bb4-8cd6-09b28b023e79 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:19.582948 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f0f8b-8886-4bb4-8cd6-09b28b023e79 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:19.583115 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f0f8b-8886-4bb4-8cd6-09b28b023e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:19.600690 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-b93f0f8b-8886-4bb4-8cd6-09b28b023e79 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:03:19.601883 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-b93f0f8b-8886-4bb4-8cd6-09b28b023e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:03:19.610197 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 569/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 17:03:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:03:19.651384 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59f970-53f5-4c7b-9296-0ea77b70244b None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:03:19.662519 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59f970-53f5-4c7b-9296-0ea77b70244b None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:03:19.665985 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46979ce-c3e7-4921-9a21-851c9661fba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:03:19.666619 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46979ce-c3e7-4921-9a21-851c9661fba5 service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:19.666905 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46979ce-c3e7-4921-9a21-851c9661fba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:19.667183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46979ce-c3e7-4921-9a21-851c9661fba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:19.676701 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46979ce-c3e7-4921-9a21-851c9661fba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:03:19.678133 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46979ce-c3e7-4921-9a21-851c9661fba5 service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:03:19.687099 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 587/1156] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:03:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:03:23.707962 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18d7a3-3c14-42f6-92ef-5024abb0472e None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:23.708523 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18d7a3-3c14-42f6-92ef-5024abb0472e None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:23.708523 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18d7a3-3c14-42f6-92ef-5024abb0472e None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:23.709886 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 570/1157] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 17:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:03:23.715255 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1e01a-9065-42de-98e1-c8ef57b3c1e2 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:23.715684 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1e01a-9065-42de-98e1-c8ef57b3c1e2 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:23.715832 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1e01a-9065-42de-98e1-c8ef57b3c1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:23.735951 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-40f1e01a-9065-42de-98e1-c8ef57b3c1e2 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:03:23.737787 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-40f1e01a-9065-42de-98e1-c8ef57b3c1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:03:23.745521 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 588/1158] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 17:03:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:03:24.022343 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18d7a3-3c14-42f6-92ef-5024abb0472e None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:03:24.024043 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-9b18d7a3-3c14-42f6-92ef-5024abb0472e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:03:24.078711 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18d7a3-3c14-42f6-92ef-5024abb0472e None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:03:24.082801 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f837938-bc18-4c38-894d-a8441a0f92b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83541095ea5646038feef0764f0473c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:03:24.083434 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f837938-bc18-4c38-894d-a8441a0f92b9 service cinder] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:24.083749 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f837938-bc18-4c38-894d-a8441a0f92b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:24.084031 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f837938-bc18-4c38-894d-a8441a0f92b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:24.092728 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f837938-bc18-4c38-894d-a8441a0f92b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:03:24.094153 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f837938-bc18-4c38-894d-a8441a0f92b9 service cinder] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:03:24.104278 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 571/1159] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:03:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:03:26.413742 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab8aed-67d0-47be-89df-c10eb13909a4 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:26.414327 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab8aed-67d0-47be-89df-c10eb13909a4 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:26.414327 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab8aed-67d0-47be-89df-c10eb13909a4 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:26.415673 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 589/1160] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 17:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:03:26.420921 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1aaa9-f6f9-41e6-8dd9-6dff06baefdb None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:26.421287 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1aaa9-f6f9-41e6-8dd9-6dff06baefdb None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:26.421368 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1aaa9-f6f9-41e6-8dd9-6dff06baefdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:26.439323 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-a5a1aaa9-f6f9-41e6-8dd9-6dff06baefdb None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:03:26.440561 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-a5a1aaa9-f6f9-41e6-8dd9-6dff06baefdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:03:26.448184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 572/1161] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 17:03:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:03:26.718457 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab8aed-67d0-47be-89df-c10eb13909a4 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:03:26.720174 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-5eab8aed-67d0-47be-89df-c10eb13909a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:03:26.733567 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab8aed-67d0-47be-89df-c10eb13909a4 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:03:26.737623 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8d943-c4cb-4d58-ae77-6a527cd2f85c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83541095ea5646038feef0764f0473c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:03:26.738253 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8d943-c4cb-4d58-ae77-6a527cd2f85c service cinder] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:03:26.738536 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8d943-c4cb-4d58-ae77-6a527cd2f85c service cinder] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:03:26.738814 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8d943-c4cb-4d58-ae77-6a527cd2f85c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:03:26.747474 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8d943-c4cb-4d58-ae77-6a527cd2f85c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:03:26.748932 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8d943-c4cb-4d58-ae77-6a527cd2f85c service cinder] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:03:26.758180 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 590/1162] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:03:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:04:49.194818 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c9c1b-c8ee-4e99-8d29-c66144ec0ae2 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:49.195467 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c9c1b-c8ee-4e99-8d29-c66144ec0ae2 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:49.195467 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c9c1b-c8ee-4e99-8d29-c66144ec0ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:49.201205 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba547601-3a03-4f87-9667-2fab728b267f None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:49.201643 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba547601-3a03-4f87-9667-2fab728b267f None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:49.201766 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba547601-3a03-4f87-9667-2fab728b267f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:49.212653 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-3d5c9c1b-c8ee-4e99-8d29-c66144ec0ae2 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:04:49.213832 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-3d5c9c1b-c8ee-4e99-8d29-c66144ec0ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:04:49.218776 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-ba547601-3a03-4f87-9667-2fab728b267f None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:04:49.219959 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-ba547601-3a03-4f87-9667-2fab728b267f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:04:49.221492 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 573/1163] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:04:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:04:49.230845 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffd540-0402-459d-9ddf-7d03abc3ec56 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:49.231128 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffd540-0402-459d-9ddf-7d03abc3ec56 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:49.231589 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffd540-0402-459d-9ddf-7d03abc3ec56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:49.235318 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 591/1164] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:04:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:04:49.245933 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019de423-2d27-46c2-a902-fdaeaad1c05b None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:49.246217 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019de423-2d27-46c2-a902-fdaeaad1c05b None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:49.246501 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019de423-2d27-46c2-a902-fdaeaad1c05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:49.250593 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-e9ffd540-0402-459d-9ddf-7d03abc3ec56 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:04:49.251809 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-e9ffd540-0402-459d-9ddf-7d03abc3ec56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:04:49.260025 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 574/1165] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:04:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:04:49.264525 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-019de423-2d27-46c2-a902-fdaeaad1c05b None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:04:49.264670 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffd540-0402-459d-9ddf-7d03abc3ec56 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:49.265703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-019de423-2d27-46c2-a902-fdaeaad1c05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:04:49.273131 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffd540-0402-459d-9ddf-7d03abc3ec56 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:49.273510 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 592/1166] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:04:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:04:49.277589 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba781307-d4ba-4e05-b3fa-b12a9af32ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:49.277813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019de423-2d27-46c2-a902-fdaeaad1c05b None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:49.278219 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba781307-d4ba-4e05-b3fa-b12a9af32ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:49.278498 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba781307-d4ba-4e05-b3fa-b12a9af32ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:49.278768 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba781307-d4ba-4e05-b3fa-b12a9af32ab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:49.279475 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba781307-d4ba-4e05-b3fa-b12a9af32ab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86674) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:04:49.279805 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba781307-d4ba-4e05-b3fa-b12a9af32ab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:49.281382 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba781307-d4ba-4e05-b3fa-b12a9af32ab2 admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:49.286485 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019de423-2d27-46c2-a902-fdaeaad1c05b None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:49.291039 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262748b-7e3b-4425-a279-734fc0b07965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:49.291714 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262748b-7e3b-4425-a279-734fc0b07965 admin admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:49.292000 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262748b-7e3b-4425-a279-734fc0b07965 admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:49.292278 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262748b-7e3b-4425-a279-734fc0b07965 admin admin] PATH_INFO: `/v3/domains` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:49.299686 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 575/1167] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 12 17:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:04:49.299870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262748b-7e3b-4425-a279-734fc0b07965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86673) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 17:04:49.299870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262748b-7e3b-4425-a279-734fc0b07965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:49.299870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: WARNING py.warnings [None req-2262748b-7e3b-4425-a279-734fc0b07965 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 17:04:49.299870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: warnings.warn(msg) May 12 17:04:49.299870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: May 12 17:04:49.299870 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262748b-7e3b-4425-a279-734fc0b07965 admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:49.301633 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba781307-d4ba-4e05-b3fa-b12a9af32ab2 admin admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:49.307522 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 593/1168] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 12 17:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 17:04:49.311033 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba781307-d4ba-4e05-b3fa-b12a9af32ab2 admin admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:49.315121 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262748b-7e3b-4425-a279-734fc0b07965 admin admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:49.315857 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8586464-dd22-4aa0-88b5-d6d01d953290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:49.316975 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8586464-dd22-4aa0-88b5-d6d01d953290 admin admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:49.317253 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8586464-dd22-4aa0-88b5-d6d01d953290 admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:49.317523 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8586464-dd22-4aa0-88b5-d6d01d953290 admin admin] PATH_INFO: `/v3/projects` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:49.318193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8586464-dd22-4aa0-88b5-d6d01d953290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:49.319188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: WARNING py.warnings [None req-f8586464-dd22-4aa0-88b5-d6d01d953290 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:04:49.319188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: warnings.warn(msg) May 12 17:04:49.319188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: May 12 17:04:49.320389 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8586464-dd22-4aa0-88b5-d6d01d953290 admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:49.325431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262748b-7e3b-4425-a279-734fc0b07965 admin admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:49.330031 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecdb40-51d7-4a80-b8be-b9dc283492d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:49.330663 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecdb40-51d7-4a80-b8be-b9dc283492d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:49.330948 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecdb40-51d7-4a80-b8be-b9dc283492d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:49.331226 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecdb40-51d7-4a80-b8be-b9dc283492d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:49.331960 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecdb40-51d7-4a80-b8be-b9dc283492d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:49.333842 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecdb40-51d7-4a80-b8be-b9dc283492d5 admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:49.356433 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 576/1169] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 12 17:04:49 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:04:49.359601 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 594/1170] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 12 17:04:49 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:04:49.360680 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8586464-dd22-4aa0-88b5-d6d01d953290 admin admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:49.364039 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecdb40-51d7-4a80-b8be-b9dc283492d5 admin admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:49.422643 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecdb40-51d7-4a80-b8be-b9dc283492d5 admin admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:49.423084 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8586464-dd22-4aa0-88b5-d6d01d953290 admin admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:49.427826 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698f89f-7747-4fd3-96c3-8dea191fab3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:49.428245 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e6e73-e191-448e-a018-eb7e70d97c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:49.428492 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698f89f-7747-4fd3-96c3-8dea191fab3d admin admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:49.428778 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698f89f-7747-4fd3-96c3-8dea191fab3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:49.428889 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e6e73-e191-448e-a018-eb7e70d97c69 admin admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:49.429058 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698f89f-7747-4fd3-96c3-8dea191fab3d admin admin] PATH_INFO: `/v3/users` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:49.429163 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e6e73-e191-448e-a018-eb7e70d97c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:49.429444 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e6e73-e191-448e-a018-eb7e70d97c69 admin admin] PATH_INFO: `/v3/users` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:49.429758 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698f89f-7747-4fd3-96c3-8dea191fab3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:49.430136 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e6e73-e191-448e-a018-eb7e70d97c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:49.430804 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: WARNING py.warnings [None req-8698f89f-7747-4fd3-96c3-8dea191fab3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:04:49.430804 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: warnings.warn(msg) May 12 17:04:49.430804 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: May 12 17:04:49.432039 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698f89f-7747-4fd3-96c3-8dea191fab3d admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:49.432163 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e6e73-e191-448e-a018-eb7e70d97c69 admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:49.452525 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 595/1171] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 12 17:04:49 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:04:49.453781 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 577/1172] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 12 17:04:49 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:04:49.456538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698f89f-7747-4fd3-96c3-8dea191fab3d admin admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:49.457526 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e6e73-e191-448e-a018-eb7e70d97c69 admin admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:49.465991 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698f89f-7747-4fd3-96c3-8dea191fab3d admin admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:49.466629 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e6e73-e191-448e-a018-eb7e70d97c69 admin admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:49.470572 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001434cf-39e8-4a1f-84d0-0dc20c1fe811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:49.470961 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89d95a-f38e-443c-92a0-41246e31b8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:49.471219 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001434cf-39e8-4a1f-84d0-0dc20c1fe811 admin admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:49.471504 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001434cf-39e8-4a1f-84d0-0dc20c1fe811 admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:49.471617 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89d95a-f38e-443c-92a0-41246e31b8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:49.471829 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001434cf-39e8-4a1f-84d0-0dc20c1fe811 admin admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:49.471934 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89d95a-f38e-443c-92a0-41246e31b8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:49.472179 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89d95a-f38e-443c-92a0-41246e31b8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:49.472578 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001434cf-39e8-4a1f-84d0-0dc20c1fe811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:49.472884 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89d95a-f38e-443c-92a0-41246e31b8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:49.474207 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001434cf-39e8-4a1f-84d0-0dc20c1fe811 admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:49.474464 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89d95a-f38e-443c-92a0-41246e31b8e0 admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:49.484258 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 596/1173] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 12 17:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:04:49.484416 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 578/1174] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 12 17:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:04:49.488590 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89d95a-f38e-443c-92a0-41246e31b8e0 admin admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:49.488739 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001434cf-39e8-4a1f-84d0-0dc20c1fe811 admin admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:49.497916 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89d95a-f38e-443c-92a0-41246e31b8e0 admin admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:49.498070 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001434cf-39e8-4a1f-84d0-0dc20c1fe811 admin admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:49.502415 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd39202-f3a9-420b-87c1-8ff4e8850ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:49.502573 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec821b96-614f-46f4-9c8b-a7907a1eb002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:49.503052 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd39202-f3a9-420b-87c1-8ff4e8850ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:49.503244 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec821b96-614f-46f4-9c8b-a7907a1eb002 admin admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:49.503983 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd39202-f3a9-420b-87c1-8ff4e8850ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:49.504088 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec821b96-614f-46f4-9c8b-a7907a1eb002 admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:49.504260 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd39202-f3a9-420b-87c1-8ff4e8850ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:49.504385 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec821b96-614f-46f4-9c8b-a7907a1eb002 admin admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:49.504973 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd39202-f3a9-420b-87c1-8ff4e8850ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:49.505091 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec821b96-614f-46f4-9c8b-a7907a1eb002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:49.506657 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd39202-f3a9-420b-87c1-8ff4e8850ae2 admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:49.506884 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec821b96-614f-46f4-9c8b-a7907a1eb002 admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:49.517705 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 597/1175] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 12 17:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:04:49.519744 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 579/1176] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 12 17:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:04:49.522219 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec821b96-614f-46f4-9c8b-a7907a1eb002 admin admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:49.523041 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd39202-f3a9-420b-87c1-8ff4e8850ae2 admin admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:49.532646 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec821b96-614f-46f4-9c8b-a7907a1eb002 admin admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:49.533036 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd39202-f3a9-420b-87c1-8ff4e8850ae2 admin admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:49.537342 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6712b8c-9be7-4923-9995-6db70efeb852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:49.538201 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385b1aa-2f35-4937-a18e-e9c22818091e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:49.538321 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6712b8c-9be7-4923-9995-6db70efeb852 admin admin] REQUEST_METHOD: `PUT` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:49.538497 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6712b8c-9be7-4923-9995-6db70efeb852 admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:49.538768 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6712b8c-9be7-4923-9995-6db70efeb852 admin admin] PATH_INFO: `/v3/projects/13c4d42106c4481297ff29ddd393c5df/users/b2f2e020880543389daea8dba059ff9d/roles/0474b158b4bc4046ac169d53fff04721` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:49.539325 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385b1aa-2f35-4937-a18e-e9c22818091e admin admin] REQUEST_METHOD: `PUT` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:49.539729 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385b1aa-2f35-4937-a18e-e9c22818091e admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:49.540135 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385b1aa-2f35-4937-a18e-e9c22818091e admin admin] PATH_INFO: `/v3/projects/3306be1e37814afd94f20979b813993c/users/6347f449387647c28061d82b0b47eb3c/roles/0474b158b4bc4046ac169d53fff04721` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:49.554107 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6712b8c-9be7-4923-9995-6db70efeb852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c4d42106c4481297ff29ddd393c5df, user_id=b2f2e020880543389daea8dba059ff9d, role_id=0474b158b4bc4046ac169d53fff04721)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:49.555416 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385b1aa-2f35-4937-a18e-e9c22818091e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3306be1e37814afd94f20979b813993c, user_id=6347f449387647c28061d82b0b47eb3c, role_id=0474b158b4bc4046ac169d53fff04721)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:49.556483 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: WARNING py.warnings [None req-7385b1aa-2f35-4937-a18e-e9c22818091e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:04:49.556483 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: warnings.warn(msg) May 12 17:04:49.556483 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: May 12 17:04:49.556807 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6712b8c-9be7-4923-9995-6db70efeb852 admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:49.558573 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385b1aa-2f35-4937-a18e-e9c22818091e admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:49.570410 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 598/1177] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 12 17:04:49 2022] PUT /identity/v3/projects/13c4d42106c4481297ff29ddd393c5df/users/b2f2e020880543389daea8dba059ff9d/roles/0474b158b4bc4046ac169d53fff04721 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:04:49.571214 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 580/1178] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 12 17:04:49 2022] PUT /identity/v3/projects/3306be1e37814afd94f20979b813993c/users/6347f449387647c28061d82b0b47eb3c/roles/0474b158b4bc4046ac169d53fff04721 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 17:04:49.576226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5620d55-9914-464b-b819-e17ba07d6aab None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:49.576366 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db7f18-e5e4-4d76-94f4-5299b66c3142 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:49.576512 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5620d55-9914-464b-b819-e17ba07d6aab None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:49.576618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db7f18-e5e4-4d76-94f4-5299b66c3142 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:49.576791 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5620d55-9914-464b-b819-e17ba07d6aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:49.576886 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db7f18-e5e4-4d76-94f4-5299b66c3142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:49.594218 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-65db7f18-e5e4-4d76-94f4-5299b66c3142 None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:04:49.595017 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-c5620d55-9914-464b-b819-e17ba07d6aab None None] MFA Rules not processed for user `bbf536e8106349f196ff7b89dc343a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:04:49.595409 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-65db7f18-e5e4-4d76-94f4-5299b66c3142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:04:49.596242 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-c5620d55-9914-464b-b819-e17ba07d6aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:04:49.657331 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 581/1179] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:04:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:04:49.660352 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 599/1180] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:04:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:04:49.668272 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5620d55-9914-464b-b819-e17ba07d6aab None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:49.669942 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-c5620d55-9914-464b-b819-e17ba07d6aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:04:49.670065 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db7f18-e5e4-4d76-94f4-5299b66c3142 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:49.721641 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db7f18-e5e4-4d76-94f4-5299b66c3142 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:49.726021 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b590bef-3869-45c6-aa29-1b3bd3cbe71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:49.726669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b590bef-3869-45c6-aa29-1b3bd3cbe71e service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:49.726954 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b590bef-3869-45c6-aa29-1b3bd3cbe71e service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:49.727232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b590bef-3869-45c6-aa29-1b3bd3cbe71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:49.735210 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5620d55-9914-464b-b819-e17ba07d6aab None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:49.736363 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b590bef-3869-45c6-aa29-1b3bd3cbe71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:49.738428 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b590bef-3869-45c6-aa29-1b3bd3cbe71e service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:49.739408 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5223e9-4c99-4ea3-8553-dea57d7f6ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:49.740079 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5223e9-4c99-4ea3-8553-dea57d7f6ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:49.740361 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5223e9-4c99-4ea3-8553-dea57d7f6ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:49.740634 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5223e9-4c99-4ea3-8553-dea57d7f6ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:49.747638 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 600/1181] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:04:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:04:49.749468 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5223e9-4c99-4ea3-8553-dea57d7f6ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:49.750939 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5223e9-4c99-4ea3-8553-dea57d7f6ee9 service neutron] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:49.760372 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 582/1182] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:04:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:04:54.474947 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdd4fe-c900-418d-b8ba-cf671e725a65 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:54.475476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdd4fe-c900-418d-b8ba-cf671e725a65 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:54.475476 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdd4fe-c900-418d-b8ba-cf671e725a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:54.513073 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-5dcdd4fe-c900-418d-b8ba-cf671e725a65 None None] MFA Rules not processed for user `b2f2e020880543389daea8dba059ff9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:04:54.514405 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-5dcdd4fe-c900-418d-b8ba-cf671e725a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:04:54.665780 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 601/1183] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:04:54 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:04:54.669834 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5223e9-4c99-4ea3-8553-dea57d7f6ee9 service neutron] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:54.681445 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5223e9-4c99-4ea3-8553-dea57d7f6ee9 service neutron] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:54.691253 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecf907-0f4d-4fef-9df5-65a07b81c410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:54.691979 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecf907-0f4d-4fef-9df5-65a07b81c410 admin admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:54.692266 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecf907-0f4d-4fef-9df5-65a07b81c410 admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:54.692544 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecf907-0f4d-4fef-9df5-65a07b81c410 admin admin] PATH_INFO: `/v3/projects` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:54.693265 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecf907-0f4d-4fef-9df5-65a07b81c410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:54.695258 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecf907-0f4d-4fef-9df5-65a07b81c410 admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:54.757717 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 583/1184] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 12 17:04:54 2022] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:04:54.762185 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdd4fe-c900-418d-b8ba-cf671e725a65 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:54.779031 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdd4fe-c900-418d-b8ba-cf671e725a65 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:54.875221 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b796e0-1e89-49ef-bcc4-a77b0019f5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:54.876109 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b796e0-1e89-49ef-bcc4-a77b0019f5f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:54.876406 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b796e0-1e89-49ef-bcc4-a77b0019f5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:54.876679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b796e0-1e89-49ef-bcc4-a77b0019f5f3 admin admin] PATH_INFO: `/v3/users` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:54.877401 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b796e0-1e89-49ef-bcc4-a77b0019f5f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:54.880000 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b796e0-1e89-49ef-bcc4-a77b0019f5f3 admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:54.922054 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 602/1185] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 12 17:04:54 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:04:54.926363 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecf907-0f4d-4fef-9df5-65a07b81c410 admin admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:54.945278 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecf907-0f4d-4fef-9df5-65a07b81c410 admin admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:54.950619 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b68527-1a1d-4e47-a71e-d379898de47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:54.951369 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b68527-1a1d-4e47-a71e-d379898de47d admin admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:54.952098 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b68527-1a1d-4e47-a71e-d379898de47d admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:54.952554 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b68527-1a1d-4e47-a71e-d379898de47d admin admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:54.953284 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b68527-1a1d-4e47-a71e-d379898de47d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:54.954924 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b68527-1a1d-4e47-a71e-d379898de47d admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:54.971495 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 584/1186] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 12 17:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:04:54.975291 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b796e0-1e89-49ef-bcc4-a77b0019f5f3 admin admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:54.989212 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b796e0-1e89-49ef-bcc4-a77b0019f5f3 admin admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:54.995909 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed14b3-5d1b-43ee-b8f2-36d6c7d39513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:54.997302 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed14b3-5d1b-43ee-b8f2-36d6c7d39513 admin admin] REQUEST_METHOD: `PUT` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:54.997680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed14b3-5d1b-43ee-b8f2-36d6c7d39513 admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:54.998248 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed14b3-5d1b-43ee-b8f2-36d6c7d39513 admin admin] PATH_INFO: `/v3/projects/6173ada980f6436db9a1af20571facb1/users/fb7aa5dfc1164aa08192399ac560a13b/roles/fbd6364b42a641f695c0b265a789057a` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:55.017722 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed14b3-5d1b-43ee-b8f2-36d6c7d39513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6173ada980f6436db9a1af20571facb1, user_id=fb7aa5dfc1164aa08192399ac560a13b, role_id=fbd6364b42a641f695c0b265a789057a)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:55.021348 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed14b3-5d1b-43ee-b8f2-36d6c7d39513 admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:55.049158 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b68527-1a1d-4e47-a71e-d379898de47d admin admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:55.051014 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 603/1187] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 12 17:04:54 2022] PUT /identity/v3/projects/6173ada980f6436db9a1af20571facb1/users/fb7aa5dfc1164aa08192399ac560a13b/roles/fbd6364b42a641f695c0b265a789057a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:04:55.063168 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b68527-1a1d-4e47-a71e-d379898de47d admin admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:55.183463 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a05dd4-d54e-49f0-8931-0012e5e42547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:55.184591 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a05dd4-d54e-49f0-8931-0012e5e42547 admin admin] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:55.185094 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a05dd4-d54e-49f0-8931-0012e5e42547 admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:55.185581 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a05dd4-d54e-49f0-8931-0012e5e42547 admin admin] PATH_INFO: `/v3/roles` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:55.186527 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a05dd4-d54e-49f0-8931-0012e5e42547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:55.188757 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a05dd4-d54e-49f0-8931-0012e5e42547 admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:55.214785 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 585/1188] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 12 17:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:04:55.218838 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed14b3-5d1b-43ee-b8f2-36d6c7d39513 admin admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:55.237822 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed14b3-5d1b-43ee-b8f2-36d6c7d39513 admin admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:55.244787 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd8775-d1ea-457f-b8c7-ca6c1ed2633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:55.245693 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd8775-d1ea-457f-b8c7-ca6c1ed2633d admin admin] REQUEST_METHOD: `PUT` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:55.245972 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd8775-d1ea-457f-b8c7-ca6c1ed2633d admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:55.246242 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd8775-d1ea-457f-b8c7-ca6c1ed2633d admin admin] PATH_INFO: `/v3/projects/6173ada980f6436db9a1af20571facb1/users/fb7aa5dfc1164aa08192399ac560a13b/roles/fbd6364b42a641f695c0b265a789057a` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:55.250294 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd8775-d1ea-457f-b8c7-ca6c1ed2633d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6173ada980f6436db9a1af20571facb1, user_id=fb7aa5dfc1164aa08192399ac560a13b, role_id=fbd6364b42a641f695c0b265a789057a)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:55.253628 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd8775-d1ea-457f-b8c7-ca6c1ed2633d admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:55.268312 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 604/1189] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 12 17:04:55 2022] PUT /identity/v3/projects/6173ada980f6436db9a1af20571facb1/users/fb7aa5dfc1164aa08192399ac560a13b/roles/fbd6364b42a641f695c0b265a789057a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:04:55.493357 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cf827-8080-48ae-9c21-f548840b5f00 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:55.493958 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cf827-8080-48ae-9c21-f548840b5f00 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:55.494750 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cf827-8080-48ae-9c21-f548840b5f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:55.524378 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-959cf827-8080-48ae-9c21-f548840b5f00 None None] MFA Rules not processed for user `6347f449387647c28061d82b0b47eb3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:04:55.525586 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-959cf827-8080-48ae-9c21-f548840b5f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:04:55.600850 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 586/1190] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:04:55 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:04:55.601137 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd8775-d1ea-457f-b8c7-ca6c1ed2633d admin admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:55.711267 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd8775-d1ea-457f-b8c7-ca6c1ed2633d admin admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:55.717128 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e9a6c-46bf-4a33-afef-334484070e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:55.718240 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e9a6c-46bf-4a33-afef-334484070e82 admin admin] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:55.718703 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e9a6c-46bf-4a33-afef-334484070e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:55.719151 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e9a6c-46bf-4a33-afef-334484070e82 admin admin] PATH_INFO: `/v3/projects` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:55.720175 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e9a6c-46bf-4a33-afef-334484070e82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:55.722822 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e9a6c-46bf-4a33-afef-334484070e82 admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:55.760264 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 605/1191] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 12 17:04:55 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 17:04:55.764131 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cf827-8080-48ae-9c21-f548840b5f00 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:55.778245 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cf827-8080-48ae-9c21-f548840b5f00 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:55.858959 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb44ca-c3cf-49bd-aadd-cc147dad0519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:55.859716 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb44ca-c3cf-49bd-aadd-cc147dad0519 admin admin] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:55.860008 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb44ca-c3cf-49bd-aadd-cc147dad0519 admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:55.860289 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb44ca-c3cf-49bd-aadd-cc147dad0519 admin admin] PATH_INFO: `/v3/users` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:55.861045 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb44ca-c3cf-49bd-aadd-cc147dad0519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:55.863674 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb44ca-c3cf-49bd-aadd-cc147dad0519 admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:55.887753 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 587/1192] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 12 17:04:55 2022] POST /identity/v3/users => generated 298 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 17:04:55.891997 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e9a6c-46bf-4a33-afef-334484070e82 admin admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:55.903410 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e9a6c-46bf-4a33-afef-334484070e82 admin admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:55.918885 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ee06b-2ee7-4978-b92b-06de29db6ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:55.919777 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ee06b-2ee7-4978-b92b-06de29db6ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:55.920165 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ee06b-2ee7-4978-b92b-06de29db6ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:55.920541 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ee06b-2ee7-4978-b92b-06de29db6ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:55.921374 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ee06b-2ee7-4978-b92b-06de29db6ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:55.923527 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ee06b-2ee7-4978-b92b-06de29db6ae1 admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:55.949946 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb44ca-c3cf-49bd-aadd-cc147dad0519 admin admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:55.950429 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 606/1193] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 12 17:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 17:04:55.967462 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb44ca-c3cf-49bd-aadd-cc147dad0519 admin admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:55.975211 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62322df5-3b9b-4958-8d9b-db7c852615ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:55.976358 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62322df5-3b9b-4958-8d9b-db7c852615ef admin admin] REQUEST_METHOD: `PUT` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:55.976808 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62322df5-3b9b-4958-8d9b-db7c852615ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:55.977246 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62322df5-3b9b-4958-8d9b-db7c852615ef admin admin] PATH_INFO: `/v3/projects/c3f100b7fae64322bb622e604a68672a/users/290a22372bee4a999083504f89e684ff/roles/fbd6364b42a641f695c0b265a789057a` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:56.005922 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62322df5-3b9b-4958-8d9b-db7c852615ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f100b7fae64322bb622e604a68672a, user_id=290a22372bee4a999083504f89e684ff, role_id=fbd6364b42a641f695c0b265a789057a)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:56.010515 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62322df5-3b9b-4958-8d9b-db7c852615ef admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:56.031992 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 588/1194] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 12 17:04:55 2022] PUT /identity/v3/projects/c3f100b7fae64322bb622e604a68672a/users/290a22372bee4a999083504f89e684ff/roles/fbd6364b42a641f695c0b265a789057a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:04:56.033746 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ee06b-2ee7-4978-b92b-06de29db6ae1 admin admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:56.051431 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ee06b-2ee7-4978-b92b-06de29db6ae1 admin admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:56.139593 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2be844-1716-470e-b724-a8d499ceaa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:56.140669 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2be844-1716-470e-b724-a8d499ceaa95 admin admin] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:56.141246 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2be844-1716-470e-b724-a8d499ceaa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:56.141713 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2be844-1716-470e-b724-a8d499ceaa95 admin admin] PATH_INFO: `/v3/roles` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:56.142745 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2be844-1716-470e-b724-a8d499ceaa95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:56.144761 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2be844-1716-470e-b724-a8d499ceaa95 admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:56.159540 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 607/1195] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 12 17:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 17:04:56.160211 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62322df5-3b9b-4958-8d9b-db7c852615ef admin admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:04:56.181483 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62322df5-3b9b-4958-8d9b-db7c852615ef admin admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:04:56.193534 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375373a-fd1e-4577-865a-9bb0ad932dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:04:56.194466 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375373a-fd1e-4577-865a-9bb0ad932dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:04:56.194751 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375373a-fd1e-4577-865a-9bb0ad932dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:04:56.195030 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375373a-fd1e-4577-865a-9bb0ad932dc9 admin admin] PATH_INFO: `/v3/projects/c3f100b7fae64322bb622e604a68672a/users/290a22372bee4a999083504f89e684ff/roles/fbd6364b42a641f695c0b265a789057a` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:04:56.200683 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375373a-fd1e-4577-865a-9bb0ad932dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f100b7fae64322bb622e604a68672a, user_id=290a22372bee4a999083504f89e684ff, role_id=fbd6364b42a641f695c0b265a789057a)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:04:56.203480 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375373a-fd1e-4577-865a-9bb0ad932dc9 admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:04:56.217911 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 589/1196] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 12 17:04:56 2022] PUT /identity/v3/projects/c3f100b7fae64322bb622e604a68672a/users/290a22372bee4a999083504f89e684ff/roles/fbd6364b42a641f695c0b265a789057a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:05:01.666551 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d3bf3-1767-4518-a637-d946c616d6ef None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:01.667757 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d3bf3-1767-4518-a637-d946c616d6ef None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:01.668243 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d3bf3-1767-4518-a637-d946c616d6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:01.722148 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-960d3bf3-1767-4518-a637-d946c616d6ef None None] MFA Rules not processed for user `fb7aa5dfc1164aa08192399ac560a13b`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:05:01.723714 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-960d3bf3-1767-4518-a637-d946c616d6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:05:01.812798 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 608/1197] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:05:01 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:05:01.828649 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375373a-fd1e-4577-865a-9bb0ad932dc9 admin admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:05:01.831917 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-3375373a-fd1e-4577-865a-9bb0ad932dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:05:01.959168 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375373a-fd1e-4577-865a-9bb0ad932dc9 admin admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:05:01.963681 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7dd055-93ce-4103-b8d1-994d48fba0e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deb66d4bda564438852a38a4a4116ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:05:01.965401 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7dd055-93ce-4103-b8d1-994d48fba0e3 service glance] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:01.965849 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7dd055-93ce-4103-b8d1-994d48fba0e3 service glance] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:01.969395 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7dd055-93ce-4103-b8d1-994d48fba0e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:02.069298 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7dd055-93ce-4103-b8d1-994d48fba0e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:05:02.071787 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7dd055-93ce-4103-b8d1-994d48fba0e3 service glance] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:05:02.114320 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 590/1198] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:05:01 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:05:02.792574 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c94dc-c810-4859-b253-0d84c59161d6 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:02.793131 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c94dc-c810-4859-b253-0d84c59161d6 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:02.793527 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c94dc-c810-4859-b253-0d84c59161d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:02.826088 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-5f0c94dc-c810-4859-b253-0d84c59161d6 None None] MFA Rules not processed for user `290a22372bee4a999083504f89e684ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:05:02.827471 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-5f0c94dc-c810-4859-b253-0d84c59161d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:05:02.916129 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 609/1199] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:05:02 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:05:02.931223 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7dd055-93ce-4103-b8d1-994d48fba0e3 service glance] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:05:02.943491 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7dd055-93ce-4103-b8d1-994d48fba0e3 service glance] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:05:02.948442 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f34cc-79f0-41f4-bf05-4a7b4aca3775 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deb66d4bda564438852a38a4a4116ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:05:02.949678 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f34cc-79f0-41f4-bf05-4a7b4aca3775 service glance] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:02.950192 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f34cc-79f0-41f4-bf05-4a7b4aca3775 service glance] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:02.950933 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f34cc-79f0-41f4-bf05-4a7b4aca3775 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:03.052768 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f34cc-79f0-41f4-bf05-4a7b4aca3775 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:05:03.054869 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f34cc-79f0-41f4-bf05-4a7b4aca3775 service glance] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:05:03.067109 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 591/1200] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:05:02 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:05:11.481117 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97056979-292d-412a-83b0-df1135875a23 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:11.481682 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97056979-292d-412a-83b0-df1135875a23 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:11.481791 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97056979-292d-412a-83b0-df1135875a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:11.499482 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-97056979-292d-412a-83b0-df1135875a23 None None] MFA Rules not processed for user `6347f449387647c28061d82b0b47eb3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:05:11.500791 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-97056979-292d-412a-83b0-df1135875a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:05:11.508193 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 610/1201] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:05:11 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:05:11.788624 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8b3a8-37fb-4364-81c4-36097b954ace None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:11.789120 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8b3a8-37fb-4364-81c4-36097b954ace None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:11.789226 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8b3a8-37fb-4364-81c4-36097b954ace None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:11.790644 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 592/1202] 10.222.0.64 () {54 vars in 961 bytes} [Thu May 12 17:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:05:11.795467 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ec17a-bbfa-434e-9428-9348e7696768 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:11.795796 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ec17a-bbfa-434e-9428-9348e7696768 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:11.796080 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ec17a-bbfa-434e-9428-9348e7696768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:11.825795 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-a17ec17a-bbfa-434e-9428-9348e7696768 None None] MFA Rules not processed for user `cd52d2543a9f4b5d9270a12544b0a021`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:05:11.827157 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-a17ec17a-bbfa-434e-9428-9348e7696768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:05:11.888640 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 611/1203] 10.222.0.64 () {58 vars in 1058 bytes} [Thu May 12 17:05:11 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:05:11.894637 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaa880-b1de-46d1-9905-f33ea2cb7fd8 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:11.894925 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaa880-b1de-46d1-9905-f33ea2cb7fd8 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:11.895198 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccaa880-b1de-46d1-9905-f33ea2cb7fd8 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:11.896574 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 593/1204] 10.222.0.64 () {54 vars in 912 bytes} [Thu May 12 17:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:05:11.901624 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d91cd5-10a6-4ec8-ba4f-648982a1619c None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:11.901923 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d91cd5-10a6-4ec8-ba4f-648982a1619c None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:11.902232 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d91cd5-10a6-4ec8-ba4f-648982a1619c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:11.920477 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-38d91cd5-10a6-4ec8-ba4f-648982a1619c None None] MFA Rules not processed for user `cd52d2543a9f4b5d9270a12544b0a021`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:05:11.921659 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-38d91cd5-10a6-4ec8-ba4f-648982a1619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:05:11.931045 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 612/1205] 10.222.0.64 () {58 vars in 1009 bytes} [Thu May 12 17:05:11 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:05:11.943091 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaa880-b1de-46d1-9905-f33ea2cb7fd8 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:05:11.944891 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-9ccaa880-b1de-46d1-9905-f33ea2cb7fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:05:11.957879 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccaa880-b1de-46d1-9905-f33ea2cb7fd8 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:05:11.961734 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750c7f5-ecf8-466a-b437-cd75ff1b8d26 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'deb66d4bda564438852a38a4a4116ccb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:05:11.962367 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750c7f5-ecf8-466a-b437-cd75ff1b8d26 service glance] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:11.962648 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750c7f5-ecf8-466a-b437-cd75ff1b8d26 service glance] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:11.962925 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750c7f5-ecf8-466a-b437-cd75ff1b8d26 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:11.972441 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750c7f5-ecf8-466a-b437-cd75ff1b8d26 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:05:11.974140 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750c7f5-ecf8-466a-b437-cd75ff1b8d26 service glance] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:05:11.984722 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 594/1206] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:05:11 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:05:12.331762 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9f020-e0ea-4a3c-af88-d7adb75c0fc1 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:12.332054 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9f020-e0ea-4a3c-af88-d7adb75c0fc1 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:12.332333 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9f020-e0ea-4a3c-af88-d7adb75c0fc1 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:12.333713 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 613/1207] 10.222.0.64 () {54 vars in 912 bytes} [Thu May 12 17:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:05:12.338712 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6c7fc-22a6-421d-a3fb-0982f1700a1e None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:12.339212 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6c7fc-22a6-421d-a3fb-0982f1700a1e None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:12.339499 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6c7fc-22a6-421d-a3fb-0982f1700a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:12.358712 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-1bc6c7fc-22a6-421d-a3fb-0982f1700a1e None None] MFA Rules not processed for user `b2cc0957b3e2402b8e6f47d46bfa02be`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:05:12.360099 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-1bc6c7fc-22a6-421d-a3fb-0982f1700a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:05:12.411152 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 595/1208] 10.222.0.64 () {58 vars in 1009 bytes} [Thu May 12 17:05:12 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 17:05:12.422048 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9f020-e0ea-4a3c-af88-d7adb75c0fc1 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:05:12.433764 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9f020-e0ea-4a3c-af88-d7adb75c0fc1 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:05:12.437909 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12ef7a-2d7a-4436-96b7-06781cd7bafb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:05:12.438556 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12ef7a-2d7a-4436-96b7-06781cd7bafb service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:12.438838 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12ef7a-2d7a-4436-96b7-06781cd7bafb service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:12.439114 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12ef7a-2d7a-4436-96b7-06781cd7bafb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:12.447100 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12ef7a-2d7a-4436-96b7-06781cd7bafb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:05:12.448678 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12ef7a-2d7a-4436-96b7-06781cd7bafb service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:05:12.457012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 614/1209] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:05:12 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:05:12.902667 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb515c0-2d9f-4ed3-bfd2-01b8095bed93 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:12.903243 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb515c0-2d9f-4ed3-bfd2-01b8095bed93 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:12.903243 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb515c0-2d9f-4ed3-bfd2-01b8095bed93 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:12.904952 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 596/1210] 10.222.0.64 () {54 vars in 961 bytes} [Thu May 12 17:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:05:12.912477 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daa5b0-c535-4367-a395-d756fdbd41fb None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:12.912477 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daa5b0-c535-4367-a395-d756fdbd41fb None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:12.912965 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daa5b0-c535-4367-a395-d756fdbd41fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:12.919095 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46074cc6-7655-4f81-b4ab-e8bab11a43f1 None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:12.919483 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46074cc6-7655-4f81-b4ab-e8bab11a43f1 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:12.919816 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46074cc6-7655-4f81-b4ab-e8bab11a43f1 None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:12.921203 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 597/1211] 10.222.0.64 () {54 vars in 960 bytes} [Thu May 12 17:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 17:05:12.927212 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcec13-3767-4349-857b-4de938d3bdf9 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:12.927495 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcec13-3767-4349-857b-4de938d3bdf9 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:12.927805 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcec13-3767-4349-857b-4de938d3bdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:12.938101 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-65daa5b0-c535-4367-a395-d756fdbd41fb None None] MFA Rules not processed for user `cd52d2543a9f4b5d9270a12544b0a021`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:05:12.939403 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-65daa5b0-c535-4367-a395-d756fdbd41fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:05:12.953193 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-ffdcec13-3767-4349-857b-4de938d3bdf9 None None] MFA Rules not processed for user `8c64a6e5ef494d00817bb47cd6fd2bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:05:12.956559 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-ffdcec13-3767-4349-857b-4de938d3bdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:05:12.968933 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 615/1212] 10.222.0.64 () {58 vars in 1058 bytes} [Thu May 12 17:05:12 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:05:12.970695 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e22703-8601-44d8-aa42-87aef17362c2 None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:12.971035 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e22703-8601-44d8-aa42-87aef17362c2 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:12.971297 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e22703-8601-44d8-aa42-87aef17362c2 None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:12.977799 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 616/1213] 10.222.0.64 () {54 vars in 912 bytes} [Thu May 12 17:05:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:05:12.979741 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788a17d-0e13-4206-b8d0-f81e3cd74295 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:12.980036 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788a17d-0e13-4206-b8d0-f81e3cd74295 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:12.980513 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788a17d-0e13-4206-b8d0-f81e3cd74295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:13.005770 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-2788a17d-0e13-4206-b8d0-f81e3cd74295 None None] MFA Rules not processed for user `cd52d2543a9f4b5d9270a12544b0a021`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:05:13.007956 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-2788a17d-0e13-4206-b8d0-f81e3cd74295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:05:13.024280 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 617/1214] 10.222.0.64 () {58 vars in 1009 bytes} [Thu May 12 17:05:12 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:05:13.037638 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788a17d-0e13-4206-b8d0-f81e3cd74295 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:05:13.049374 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788a17d-0e13-4206-b8d0-f81e3cd74295 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:05:13.049846 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 598/1215] 10.222.0.64 () {58 vars in 1057 bytes} [Thu May 12 17:05:12 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:05:13.053478 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9488c-b488-4526-8187-298299ba5bcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:05:13.054202 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9488c-b488-4526-8187-298299ba5bcb service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:13.054553 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9488c-b488-4526-8187-298299ba5bcb service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:13.054893 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9488c-b488-4526-8187-298299ba5bcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:13.057405 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcec13-3767-4349-857b-4de938d3bdf9 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:05:13.067254 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9488c-b488-4526-8187-298299ba5bcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:05:13.070222 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9488c-b488-4526-8187-298299ba5bcb service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:05:13.073854 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcec13-3767-4349-857b-4de938d3bdf9 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:05:13.082873 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224625c-ca1c-4841-bf67-a59e2794a853 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c64a6e5ef494d00817bb47cd6fd2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:05:13.084496 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224625c-ca1c-4841-bf67-a59e2794a853 service placement] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:13.085110 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224625c-ca1c-4841-bf67-a59e2794a853 service placement] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:13.086055 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224625c-ca1c-4841-bf67-a59e2794a853 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:13.089228 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-e224625c-ca1c-4841-bf67-a59e2794a853 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:05:13.095196 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 618/1216] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:05:13 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:05:13.108516 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224625c-ca1c-4841-bf67-a59e2794a853 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:05:13.112367 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224625c-ca1c-4841-bf67-a59e2794a853 service placement] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:05:13.130309 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 599/1217] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:05:13 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 17:05:27.190008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c674c-284d-4e3d-be20-9cde274b21dc None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:27.190627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c674c-284d-4e3d-be20-9cde274b21dc None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:27.190627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c674c-284d-4e3d-be20-9cde274b21dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:27.209220 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-e48c674c-284d-4e3d-be20-9cde274b21dc None None] MFA Rules not processed for user `b2cc0957b3e2402b8e6f47d46bfa02be`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:05:27.210416 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-e48c674c-284d-4e3d-be20-9cde274b21dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:05:27.217206 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 619/1218] 10.222.0.13 () {58 vars in 1015 bytes} [Thu May 12 17:05:27 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:05:27.229282 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224625c-ca1c-4841-bf67-a59e2794a853 service placement] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:05:27.238249 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224625c-ca1c-4841-bf67-a59e2794a853 service placement] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:05:27.241786 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f946b-d50a-43b7-ae2d-8292ef39cb47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:05:27.242420 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f946b-d50a-43b7-ae2d-8292ef39cb47 service neutron] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:27.242706 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f946b-d50a-43b7-ae2d-8292ef39cb47 service neutron] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:27.242986 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f946b-d50a-43b7-ae2d-8292ef39cb47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:27.249885 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f946b-d50a-43b7-ae2d-8292ef39cb47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:05:27.251321 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f946b-d50a-43b7-ae2d-8292ef39cb47 service neutron] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:05:27.269548 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 600/1219] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:05:27 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:05:28.233524 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d81ec-df0e-4b00-b46b-dfd07769f33f None None] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:28.234087 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d81ec-df0e-4b00-b46b-dfd07769f33f None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:28.234352 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d81ec-df0e-4b00-b46b-dfd07769f33f None None] PATH_INFO: `/` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:28.237679 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 620/1220] 10.222.0.64 () {54 vars in 921 bytes} [Thu May 12 17:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:05:28.243714 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb9eda-a121-45e4-b372-0cda69de8895 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:28.244564 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb9eda-a121-45e4-b372-0cda69de8895 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:28.244865 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb9eda-a121-45e4-b372-0cda69de8895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:28.264031 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-35fb9eda-a121-45e4-b372-0cda69de8895 None None] MFA Rules not processed for user `cd52d2543a9f4b5d9270a12544b0a021`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:05:28.265522 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-35fb9eda-a121-45e4-b372-0cda69de8895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:05:28.275416 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 601/1221] 10.222.0.64 () {58 vars in 1018 bytes} [Thu May 12 17:05:28 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:05:28.327262 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d81ec-df0e-4b00-b46b-dfd07769f33f None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:05:28.352768 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d81ec-df0e-4b00-b46b-dfd07769f33f None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:05:28.362115 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ee712-41bb-4468-855c-791d5e7b6497 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:05:28.362787 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ee712-41bb-4468-855c-791d5e7b6497 service nova] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:28.363072 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ee712-41bb-4468-855c-791d5e7b6497 service nova] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:28.363354 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ee712-41bb-4468-855c-791d5e7b6497 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:28.372449 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ee712-41bb-4468-855c-791d5e7b6497 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:05:28.374813 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ee712-41bb-4468-855c-791d5e7b6497 service nova] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:05:28.386705 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 621/1222] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:05:28 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:05:35.281058 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcd285-aa61-486f-8818-1f7ff9713f9e None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:35.281700 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcd285-aa61-486f-8818-1f7ff9713f9e None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:35.281700 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcd285-aa61-486f-8818-1f7ff9713f9e None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:35.283625 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 602/1223] 10.222.0.64 () {54 vars in 921 bytes} [Thu May 12 17:05:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:05:35.294077 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8375c-3031-47ad-ac0e-b76bb8e9cfd4 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:35.294622 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8375c-3031-47ad-ac0e-b76bb8e9cfd4 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:35.294622 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8375c-3031-47ad-ac0e-b76bb8e9cfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:35.314409 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-31a8375c-3031-47ad-ac0e-b76bb8e9cfd4 None None] MFA Rules not processed for user `cd52d2543a9f4b5d9270a12544b0a021`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:05:35.315651 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-31a8375c-3031-47ad-ac0e-b76bb8e9cfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:05:35.324500 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 622/1224] 10.222.0.64 () {58 vars in 1018 bytes} [Thu May 12 17:05:35 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:05:35.338784 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcd285-aa61-486f-8818-1f7ff9713f9e None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:05:35.354625 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcd285-aa61-486f-8818-1f7ff9713f9e None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:05:35.359995 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8568c3-73a8-45a4-8db4-acbe909f5061 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:05:35.361270 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8568c3-73a8-45a4-8db4-acbe909f5061 service nova] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:35.361555 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8568c3-73a8-45a4-8db4-acbe909f5061 service nova] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:35.361836 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8568c3-73a8-45a4-8db4-acbe909f5061 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:35.370713 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8568c3-73a8-45a4-8db4-acbe909f5061 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:05:35.372340 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8568c3-73a8-45a4-8db4-acbe909f5061 service nova] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:05:35.382530 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 603/1225] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:05:35 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:05:47.511395 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8375c-3031-47ad-ac0e-b76bb8e9cfd4 None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:05:47.520454 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8375c-3031-47ad-ac0e-b76bb8e9cfd4 None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:05:47.523985 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08281c13-94cc-4cce-ba71-171b18ba661c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:05:47.524627 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08281c13-94cc-4cce-ba71-171b18ba661c service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:47.524906 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08281c13-94cc-4cce-ba71-171b18ba661c service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:47.525179 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08281c13-94cc-4cce-ba71-171b18ba661c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:47.534437 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08281c13-94cc-4cce-ba71-171b18ba661c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:05:47.535974 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08281c13-94cc-4cce-ba71-171b18ba661c service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:05:47.545206 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 623/1226] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:05:47 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:05:51.853043 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf965e-4746-4def-819f-1c209fa8f56e None None] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:51.853656 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf965e-4746-4def-819f-1c209fa8f56e None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:51.853656 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf965e-4746-4def-819f-1c209fa8f56e None None] PATH_INFO: `/` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:51.855220 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 604/1227] 10.222.0.64 () {54 vars in 921 bytes} [Thu May 12 17:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 17:05:51.870422 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e856d-566d-47ec-8e2e-6b373dc9e581 None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:51.871366 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e856d-566d-47ec-8e2e-6b373dc9e581 None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:51.871839 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e856d-566d-47ec-8e2e-6b373dc9e581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:51.916828 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-b27e856d-566d-47ec-8e2e-6b373dc9e581 None None] MFA Rules not processed for user `cd52d2543a9f4b5d9270a12544b0a021`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:05:51.918108 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-b27e856d-566d-47ec-8e2e-6b373dc9e581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:05:51.945545 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 624/1228] 10.222.0.64 () {58 vars in 1018 bytes} [Thu May 12 17:05:51 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:05:51.957631 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf965e-4746-4def-819f-1c209fa8f56e None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:05:51.981754 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf965e-4746-4def-819f-1c209fa8f56e None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:05:51.993836 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b548b-ae8a-469b-ae4f-38a465c62b17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:05:51.994692 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b548b-ae8a-469b-ae4f-38a465c62b17 service nova] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:05:51.995122 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b548b-ae8a-469b-ae4f-38a465c62b17 service nova] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:05:51.995567 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b548b-ae8a-469b-ae4f-38a465c62b17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:05:52.007253 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b548b-ae8a-469b-ae4f-38a465c62b17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:05:52.009117 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b548b-ae8a-469b-ae4f-38a465c62b17 service nova] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:05:52.019945 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 605/1229] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:05:51 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:06:00.113281 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e747e-3ab0-4742-bb69-36348c3ff83b None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:06:00.113792 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e747e-3ab0-4742-bb69-36348c3ff83b None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:06:00.113900 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e747e-3ab0-4742-bb69-36348c3ff83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:06:00.131355 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-4f9e747e-3ab0-4742-bb69-36348c3ff83b None None] MFA Rules not processed for user `b2f2e020880543389daea8dba059ff9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:06:00.132614 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-4f9e747e-3ab0-4742-bb69-36348c3ff83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:06:00.139465 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 625/1230] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:06:00 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:06:00.464218 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478ac42-bf8e-483e-a3d5-b19dbc49e6e0 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:06:00.464768 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478ac42-bf8e-483e-a3d5-b19dbc49e6e0 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:06:00.464768 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478ac42-bf8e-483e-a3d5-b19dbc49e6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:06:00.482865 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-3478ac42-bf8e-483e-a3d5-b19dbc49e6e0 None None] MFA Rules not processed for user `b2cc0957b3e2402b8e6f47d46bfa02be`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:06:00.484078 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-3478ac42-bf8e-483e-a3d5-b19dbc49e6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:06:00.491022 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 606/1231] 10.222.0.64 () {58 vars in 1009 bytes} [Thu May 12 17:06:00 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:06:00.502379 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e747e-3ab0-4742-bb69-36348c3ff83b None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:06:00.511666 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e747e-3ab0-4742-bb69-36348c3ff83b None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:06:00.515130 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bcdb2-b168-4bfd-82d0-fe9e1fbe9474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:06:00.515803 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bcdb2-b168-4bfd-82d0-fe9e1fbe9474 service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:06:00.516089 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bcdb2-b168-4bfd-82d0-fe9e1fbe9474 service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:06:00.516370 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bcdb2-b168-4bfd-82d0-fe9e1fbe9474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:06:00.523180 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563bcdb2-b168-4bfd-82d0-fe9e1fbe9474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:06:00.524653 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563bcdb2-b168-4bfd-82d0-fe9e1fbe9474 service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:06:00.533101 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 626/1232] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:06:00 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:06:26.369918 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858412d-ebb1-463e-9754-a70d341f428b None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:06:26.370361 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858412d-ebb1-463e-9754-a70d341f428b None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:06:26.370464 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858412d-ebb1-463e-9754-a70d341f428b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:06:26.387684 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-5858412d-ebb1-463e-9754-a70d341f428b None None] MFA Rules not processed for user `b2f2e020880543389daea8dba059ff9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:06:26.388860 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-5858412d-ebb1-463e-9754-a70d341f428b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:06:26.395537 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 607/1233] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:06:26 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:06:40.739012 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43cc39-9f3f-4be1-83e0-a7163351ecea None None] REQUEST_METHOD: `POST` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:06:40.739437 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43cc39-9f3f-4be1-83e0-a7163351ecea None None] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:06:40.739598 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43cc39-9f3f-4be1-83e0-a7163351ecea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:06:40.756892 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.auth.core [None req-af43cc39-9f3f-4be1-83e0-a7163351ecea None None] MFA Rules not processed for user `b2f2e020880543389daea8dba059ff9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86673) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:06:40.758076 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-af43cc39-9f3f-4be1-83e0-a7163351ecea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:06:40.764825 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 627/1234] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:06:40 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:07:40.175106 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed77c14-b196-455c-852c-1a26c0e5373f None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:07:40.175565 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed77c14-b196-455c-852c-1a26c0e5373f None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:07:40.175692 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed77c14-b196-455c-852c-1a26c0e5373f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:07:40.193167 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-5ed77c14-b196-455c-852c-1a26c0e5373f None None] MFA Rules not processed for user `b2f2e020880543389daea8dba059ff9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:07:40.194375 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-5ed77c14-b196-455c-852c-1a26c0e5373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:07:40.201897 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 608/1235] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:07:40 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:07:52.798052 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43cc39-9f3f-4be1-83e0-a7163351ecea None None] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:07:52.816906 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43cc39-9f3f-4be1-83e0-a7163351ecea None None] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:07:52.820504 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755eced1-2a86-491d-8a7d-aaaab6b698af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:07:52.821207 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755eced1-2a86-491d-8a7d-aaaab6b698af service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:07:52.821489 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755eced1-2a86-491d-8a7d-aaaab6b698af service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:07:52.821763 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755eced1-2a86-491d-8a7d-aaaab6b698af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:07:52.832207 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755eced1-2a86-491d-8a7d-aaaab6b698af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:07:52.834093 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755eced1-2a86-491d-8a7d-aaaab6b698af service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:07:52.844060 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 628/1236] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:07:52 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:08:20.414762 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed77c14-b196-455c-852c-1a26c0e5373f None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:08:20.438261 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed77c14-b196-455c-852c-1a26c0e5373f None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:08:20.444787 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afe8e3-756e-4400-aedb-61ff3ecb6e2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c64a6e5ef494d00817bb47cd6fd2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:08:20.445424 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afe8e3-756e-4400-aedb-61ff3ecb6e2f service placement] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:08:20.445703 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afe8e3-756e-4400-aedb-61ff3ecb6e2f service placement] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:08:20.445976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afe8e3-756e-4400-aedb-61ff3ecb6e2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:08:20.455278 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afe8e3-756e-4400-aedb-61ff3ecb6e2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:08:20.457308 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afe8e3-756e-4400-aedb-61ff3ecb6e2f service placement] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:08:20.468695 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 609/1237] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:08:20 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:08:28.889414 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755eced1-2a86-491d-8a7d-aaaab6b698af service neutron] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:08:28.970393 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755eced1-2a86-491d-8a7d-aaaab6b698af service neutron] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:08:28.976281 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e2760-3c2b-4eb2-99d7-08db97cb9081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:08:28.977148 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e2760-3c2b-4eb2-99d7-08db97cb9081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:08:28.977489 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e2760-3c2b-4eb2-99d7-08db97cb9081 admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:08:28.977802 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e2760-3c2b-4eb2-99d7-08db97cb9081 admin admin] PATH_INFO: `/v3/users/6347f449387647c28061d82b0b47eb3c` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:08:28.978989 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e2760-3c2b-4eb2-99d7-08db97cb9081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6347f449387647c28061d82b0b47eb3c)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:08:28.981559 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e2760-3c2b-4eb2-99d7-08db97cb9081 admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:08:29.036437 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-148e2760-3c2b-4eb2-99d7-08db97cb9081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6347f449387647c28061d82b0b47eb3c'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:08:29.044183 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-148e2760-3c2b-4eb2-99d7-08db97cb9081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6347f449387647c28061d82b0b47eb3c'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:08:29.057413 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-148e2760-3c2b-4eb2-99d7-08db97cb9081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6347f449387647c28061d82b0b47eb3c'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:08:29.058137 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-148e2760-3c2b-4eb2-99d7-08db97cb9081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6347f449387647c28061d82b0b47eb3c'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:08:29.059610 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-148e2760-3c2b-4eb2-99d7-08db97cb9081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6347f449387647c28061d82b0b47eb3c'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:08:29.072835 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 629/1238] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 12 17:08:28 2022] DELETE /identity/v3/users/6347f449387647c28061d82b0b47eb3c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:08:29.259184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afe8e3-756e-4400-aedb-61ff3ecb6e2f service placement] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:08:29.278901 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afe8e3-756e-4400-aedb-61ff3ecb6e2f service placement] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:08:29.354233 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf2a33-8182-49ad-8520-654fe9acebac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:08:29.355094 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf2a33-8182-49ad-8520-654fe9acebac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:08:29.355381 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf2a33-8182-49ad-8520-654fe9acebac admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:08:29.355698 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf2a33-8182-49ad-8520-654fe9acebac admin admin] PATH_INFO: `/v3/projects/3306be1e37814afd94f20979b813993c` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:08:29.356895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf2a33-8182-49ad-8520-654fe9acebac admin admin] RBAC: Authorizing `identity:delete_project(project_id=3306be1e37814afd94f20979b813993c)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:08:29.358830 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf2a33-8182-49ad-8520-654fe9acebac admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:08:29.409175 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-4ddf2a33-8182-49ad-8520-654fe9acebac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3306be1e37814afd94f20979b813993c', 'request_id': 'req-4ddf2a33-8182-49ad-8520-654fe9acebac'} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:08:29.414782 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-4ddf2a33-8182-49ad-8520-654fe9acebac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3306be1e37814afd94f20979b813993c', 'request_id': 'req-4ddf2a33-8182-49ad-8520-654fe9acebac'} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:08:29.422040 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-4ddf2a33-8182-49ad-8520-654fe9acebac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3306be1e37814afd94f20979b813993c', 'request_id': 'req-4ddf2a33-8182-49ad-8520-654fe9acebac'} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:08:29.433947 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-4ddf2a33-8182-49ad-8520-654fe9acebac admin admin] The token cache is being invalidate because project 3306be1e37814afd94f20979b813993c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:08:29.434236 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-4ddf2a33-8182-49ad-8520-654fe9acebac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:08:29.434963 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-4ddf2a33-8182-49ad-8520-654fe9acebac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:08:29.436805 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 610/1239] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 12 17:08:29 2022] DELETE /identity/v3/projects/3306be1e37814afd94f20979b813993c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:08:29.441714 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e2760-3c2b-4eb2-99d7-08db97cb9081 admin admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:08:29.443238 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-148e2760-3c2b-4eb2-99d7-08db97cb9081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:08:29.457391 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e2760-3c2b-4eb2-99d7-08db97cb9081 admin admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:08:29.518442 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788c49c-8df9-46b7-b827-7b017c6d1371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:08:29.519489 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788c49c-8df9-46b7-b827-7b017c6d1371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:08:29.519905 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788c49c-8df9-46b7-b827-7b017c6d1371 admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:08:29.520264 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788c49c-8df9-46b7-b827-7b017c6d1371 admin admin] PATH_INFO: `/v3/users/290a22372bee4a999083504f89e684ff` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:08:29.521595 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788c49c-8df9-46b7-b827-7b017c6d1371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=290a22372bee4a999083504f89e684ff)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:08:29.523828 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788c49c-8df9-46b7-b827-7b017c6d1371 admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:08:29.576447 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-6788c49c-8df9-46b7-b827-7b017c6d1371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '290a22372bee4a999083504f89e684ff'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:08:29.586523 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-6788c49c-8df9-46b7-b827-7b017c6d1371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '290a22372bee4a999083504f89e684ff'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:08:29.601925 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-6788c49c-8df9-46b7-b827-7b017c6d1371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '290a22372bee4a999083504f89e684ff'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:08:29.602713 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-6788c49c-8df9-46b7-b827-7b017c6d1371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '290a22372bee4a999083504f89e684ff'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:08:29.603497 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-6788c49c-8df9-46b7-b827-7b017c6d1371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '290a22372bee4a999083504f89e684ff'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:08:29.617538 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 630/1240] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 12 17:08:29 2022] DELETE /identity/v3/users/290a22372bee4a999083504f89e684ff => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:08:29.795733 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf2a33-8182-49ad-8520-654fe9acebac admin admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:08:29.797682 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-4ddf2a33-8182-49ad-8520-654fe9acebac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:08:29.814965 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf2a33-8182-49ad-8520-654fe9acebac admin admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:08:29.879852 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21572ad2-6508-4f88-b1bd-e7c544a757e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:08:29.880780 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21572ad2-6508-4f88-b1bd-e7c544a757e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:08:29.881063 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21572ad2-6508-4f88-b1bd-e7c544a757e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:08:29.881413 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21572ad2-6508-4f88-b1bd-e7c544a757e3 admin admin] PATH_INFO: `/v3/projects/c3f100b7fae64322bb622e604a68672a` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:08:29.882888 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21572ad2-6508-4f88-b1bd-e7c544a757e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3f100b7fae64322bb622e604a68672a)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:08:29.885079 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21572ad2-6508-4f88-b1bd-e7c544a757e3 admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:08:29.936552 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-21572ad2-6508-4f88-b1bd-e7c544a757e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3f100b7fae64322bb622e604a68672a', 'request_id': 'req-21572ad2-6508-4f88-b1bd-e7c544a757e3'} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:08:29.942714 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-21572ad2-6508-4f88-b1bd-e7c544a757e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3f100b7fae64322bb622e604a68672a', 'request_id': 'req-21572ad2-6508-4f88-b1bd-e7c544a757e3'} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:08:29.951171 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-21572ad2-6508-4f88-b1bd-e7c544a757e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3f100b7fae64322bb622e604a68672a', 'request_id': 'req-21572ad2-6508-4f88-b1bd-e7c544a757e3'} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:08:29.963344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-21572ad2-6508-4f88-b1bd-e7c544a757e3 admin admin] The token cache is being invalidate because project c3f100b7fae64322bb622e604a68672a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86674) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:08:29.963663 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-21572ad2-6508-4f88-b1bd-e7c544a757e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:08:29.964279 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-21572ad2-6508-4f88-b1bd-e7c544a757e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:08:29.965873 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 611/1241] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 12 17:08:29 2022] DELETE /identity/v3/projects/c3f100b7fae64322bb622e604a68672a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:10:02.403201 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788c49c-8df9-46b7-b827-7b017c6d1371 admin admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:10:02.404869 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-6788c49c-8df9-46b7-b827-7b017c6d1371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:10:02.484288 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788c49c-8df9-46b7-b827-7b017c6d1371 admin admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:10:02.552821 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecc9ea-953a-414b-a84e-5ec0a41da25d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:10:02.553541 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecc9ea-953a-414b-a84e-5ec0a41da25d service nova] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:10:02.553848 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecc9ea-953a-414b-a84e-5ec0a41da25d service nova] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:10:02.554206 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecc9ea-953a-414b-a84e-5ec0a41da25d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:10:02.556645 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-5cecc9ea-953a-414b-a84e-5ec0a41da25d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:10:02.617093 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecc9ea-953a-414b-a84e-5ec0a41da25d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:10:02.618217 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecc9ea-953a-414b-a84e-5ec0a41da25d service nova] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:10:02.627989 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 631/1242] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:10:02 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:10:04.954625 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c3614-733a-498b-a752-ea055bd56bd7 None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:10:04.955108 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c3614-733a-498b-a752-ea055bd56bd7 None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:10:04.955248 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c3614-733a-498b-a752-ea055bd56bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:10:04.976023 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-366c3614-733a-498b-a752-ea055bd56bd7 None None] MFA Rules not processed for user `b2f2e020880543389daea8dba059ff9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:10:04.977253 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-366c3614-733a-498b-a752-ea055bd56bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:10:04.984935 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 612/1243] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:10:04 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:10:12.640756 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecc9ea-953a-414b-a84e-5ec0a41da25d service nova] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:10:12.642173 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-5cecc9ea-953a-414b-a84e-5ec0a41da25d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:10:12.695484 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecc9ea-953a-414b-a84e-5ec0a41da25d service nova] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:10:12.699054 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea19bb-db95-43aa-872d-3faeeafae3c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:10:12.699723 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea19bb-db95-43aa-872d-3faeeafae3c1 service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:10:12.700500 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea19bb-db95-43aa-872d-3faeeafae3c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:10:12.700776 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea19bb-db95-43aa-872d-3faeeafae3c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:10:12.702487 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-15ea19bb-db95-43aa-872d-3faeeafae3c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:10:12.714121 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea19bb-db95-43aa-872d-3faeeafae3c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:10:12.715551 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea19bb-db95-43aa-872d-3faeeafae3c1 service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:10:12.726171 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 632/1244] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:10:12 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:10:13.898831 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c3614-733a-498b-a752-ea055bd56bd7 None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:10:13.901229 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-366c3614-733a-498b-a752-ea055bd56bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:10:13.916817 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c3614-733a-498b-a752-ea055bd56bd7 None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:10:13.921087 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be369b0-b0c2-49c2-b3c8-cb19a49c99cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:10:13.921837 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be369b0-b0c2-49c2-b3c8-cb19a49c99cc service neutron] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:10:13.922115 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be369b0-b0c2-49c2-b3c8-cb19a49c99cc service neutron] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:10:13.922396 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be369b0-b0c2-49c2-b3c8-cb19a49c99cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:10:13.924344 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-5be369b0-b0c2-49c2-b3c8-cb19a49c99cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:10:13.936735 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be369b0-b0c2-49c2-b3c8-cb19a49c99cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:10:13.938165 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be369b0-b0c2-49c2-b3c8-cb19a49c99cc service neutron] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:10:13.948061 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 613/1245] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:10:13 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:10:59.607557 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea19bb-db95-43aa-872d-3faeeafae3c1 service neutron] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:10:59.615854 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea19bb-db95-43aa-872d-3faeeafae3c1 service neutron] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:10:59.619409 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be5bc6-ae6a-43f2-9503-e1a9549523ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:10:59.620077 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be5bc6-ae6a-43f2-9503-e1a9549523ed service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:10:59.620361 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be5bc6-ae6a-43f2-9503-e1a9549523ed service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:10:59.620671 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be5bc6-ae6a-43f2-9503-e1a9549523ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:10:59.622477 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-52be5bc6-ae6a-43f2-9503-e1a9549523ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:10:59.632165 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be5bc6-ae6a-43f2-9503-e1a9549523ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:10:59.633587 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be5bc6-ae6a-43f2-9503-e1a9549523ed service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:10:59.641218 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 633/1246] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:10:59 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:12:01.875782 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3caed-234e-4e9c-89d2-fe2db2e4cbaa None None] REQUEST_METHOD: `POST` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:12:01.876346 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3caed-234e-4e9c-89d2-fe2db2e4cbaa None None] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:12:01.876439 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3caed-234e-4e9c-89d2-fe2db2e4cbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:12:01.896930 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.auth.core [None req-eaf3caed-234e-4e9c-89d2-fe2db2e4cbaa None None] MFA Rules not processed for user `b2f2e020880543389daea8dba059ff9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86674) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 17:12:01.898173 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-eaf3caed-234e-4e9c-89d2-fe2db2e4cbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:12:01.905188 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 614/1247] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 12 17:12:01 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 17:12:02.210274 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be5bc6-ae6a-43f2-9503-e1a9549523ed service neutron] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:12:02.218567 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be5bc6-ae6a-43f2-9503-e1a9549523ed service neutron] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:12:02.222486 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d29144-fbca-4ad0-b57e-4463f7183f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:12:02.223387 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d29144-fbca-4ad0-b57e-4463f7183f15 service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:12:02.223725 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d29144-fbca-4ad0-b57e-4463f7183f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:12:02.223992 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d29144-fbca-4ad0-b57e-4463f7183f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:12:02.225754 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-29d29144-fbca-4ad0-b57e-4463f7183f15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:12:02.235556 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d29144-fbca-4ad0-b57e-4463f7183f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:12:02.237008 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d29144-fbca-4ad0-b57e-4463f7183f15 service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:12:02.245210 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 634/1248] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:12:02 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:12:02.673324 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3caed-234e-4e9c-89d2-fe2db2e4cbaa None None] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:12:02.675064 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-eaf3caed-234e-4e9c-89d2-fe2db2e4cbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:12:02.756156 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3caed-234e-4e9c-89d2-fe2db2e4cbaa None None] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:12:02.761648 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8e596-e89b-4425-b4da-7216ddf9eaab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c64a6e5ef494d00817bb47cd6fd2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:12:02.762567 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8e596-e89b-4425-b4da-7216ddf9eaab service placement] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:12:02.762855 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8e596-e89b-4425-b4da-7216ddf9eaab service placement] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:12:02.763131 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8e596-e89b-4425-b4da-7216ddf9eaab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:12:02.764875 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-48f8e596-e89b-4425-b4da-7216ddf9eaab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:12:02.776062 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8e596-e89b-4425-b4da-7216ddf9eaab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:12:02.777640 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8e596-e89b-4425-b4da-7216ddf9eaab service placement] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:12:02.786950 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 615/1249] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:12:02 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:12:05.165224 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d29144-fbca-4ad0-b57e-4463f7183f15 service neutron] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:12:05.168842 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-29d29144-fbca-4ad0-b57e-4463f7183f15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:12:05.189054 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d29144-fbca-4ad0-b57e-4463f7183f15 service neutron] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:12:05.194717 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051a2e7-4608-43d8-89d4-f644e0eae6ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:12:05.196473 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051a2e7-4608-43d8-89d4-f644e0eae6ea service nova] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:12:05.196954 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051a2e7-4608-43d8-89d4-f644e0eae6ea service nova] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:12:05.197414 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051a2e7-4608-43d8-89d4-f644e0eae6ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:12:05.199380 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-4051a2e7-4608-43d8-89d4-f644e0eae6ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:12:05.216308 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051a2e7-4608-43d8-89d4-f644e0eae6ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:12:05.218549 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051a2e7-4608-43d8-89d4-f644e0eae6ea service nova] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:12:05.240093 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 635/1250] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:12:05 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:12:11.513990 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8e596-e89b-4425-b4da-7216ddf9eaab service placement] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:12:11.525583 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8e596-e89b-4425-b4da-7216ddf9eaab service placement] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:12:11.530737 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb2106-eb49-4bf7-8683-38f258825a2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:12:11.531385 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb2106-eb49-4bf7-8683-38f258825a2e service nova] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:12:11.531699 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb2106-eb49-4bf7-8683-38f258825a2e service nova] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:12:11.531988 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb2106-eb49-4bf7-8683-38f258825a2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:12:11.533786 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-e4fb2106-eb49-4bf7-8683-38f258825a2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:12:11.545863 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb2106-eb49-4bf7-8683-38f258825a2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:12:11.547595 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb2106-eb49-4bf7-8683-38f258825a2e service nova] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:12:11.557529 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 616/1251] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:12:11 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:12:16.332066 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051a2e7-4608-43d8-89d4-f644e0eae6ea service nova] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:12:16.333535 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-4051a2e7-4608-43d8-89d4-f644e0eae6ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:12:16.346624 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051a2e7-4608-43d8-89d4-f644e0eae6ea service nova] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:12:16.352495 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67f22f-d32e-4414-8a8f-1409329161e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd52d2543a9f4b5d9270a12544b0a021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:12:16.353145 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67f22f-d32e-4414-8a8f-1409329161e3 service nova] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:12:16.353430 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67f22f-d32e-4414-8a8f-1409329161e3 service nova] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:12:16.353709 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67f22f-d32e-4414-8a8f-1409329161e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:12:16.355470 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-dc67f22f-d32e-4414-8a8f-1409329161e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:12:16.366882 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67f22f-d32e-4414-8a8f-1409329161e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:12:16.368867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67f22f-d32e-4414-8a8f-1409329161e3 service nova] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:12:16.379346 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 636/1252] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:12:16 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:14:03.566470 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb2106-eb49-4bf7-8683-38f258825a2e service nova] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:14:03.567879 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-e4fb2106-eb49-4bf7-8683-38f258825a2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:14:03.627549 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb2106-eb49-4bf7-8683-38f258825a2e service nova] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:14:03.632511 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5e372-cc7e-4e37-b234-2a90fb7f3c7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c64a6e5ef494d00817bb47cd6fd2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:14:03.633144 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5e372-cc7e-4e37-b234-2a90fb7f3c7e service placement] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:14:03.633427 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5e372-cc7e-4e37-b234-2a90fb7f3c7e service placement] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:14:03.633704 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5e372-cc7e-4e37-b234-2a90fb7f3c7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:14:03.635436 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-4eb5e372-cc7e-4e37-b234-2a90fb7f3c7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:14:03.646124 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5e372-cc7e-4e37-b234-2a90fb7f3c7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:14:03.647717 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5e372-cc7e-4e37-b234-2a90fb7f3c7e service placement] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:14:03.657687 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 617/1253] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:14:03 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:14:47.579036 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67f22f-d32e-4414-8a8f-1409329161e3 service nova] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:14:47.597130 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67f22f-d32e-4414-8a8f-1409329161e3 service nova] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:14:47.600905 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b40df-745a-4ab7-9243-663138b6637a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2cc0957b3e2402b8e6f47d46bfa02be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:14:47.601533 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b40df-745a-4ab7-9243-663138b6637a service neutron] REQUEST_METHOD: `GET` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:14:47.601812 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b40df-745a-4ab7-9243-663138b6637a service neutron] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:14:47.602089 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b40df-745a-4ab7-9243-663138b6637a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:14:47.604434 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-d45b40df-745a-4ab7-9243-663138b6637a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:14:47.684422 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b40df-745a-4ab7-9243-663138b6637a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:14:47.685867 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b40df-745a-4ab7-9243-663138b6637a service neutron] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:14:47.695265 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 637/1254] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:14:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 17:14:54.140250 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5e372-cc7e-4e37-b234-2a90fb7f3c7e service placement] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:14:54.142565 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-4eb5e372-cc7e-4e37-b234-2a90fb7f3c7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:14:54.161310 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5e372-cc7e-4e37-b234-2a90fb7f3c7e service placement] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:14:54.167074 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952b138-a743-40f1-a1cb-03901e3dd91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:14:54.168469 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952b138-a743-40f1-a1cb-03901e3dd91e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:14:54.168755 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952b138-a743-40f1-a1cb-03901e3dd91e admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:14:54.169034 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952b138-a743-40f1-a1cb-03901e3dd91e admin admin] PATH_INFO: `/v3/users/b2f2e020880543389daea8dba059ff9d` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:14:54.192532 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952b138-a743-40f1-a1cb-03901e3dd91e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f2e020880543389daea8dba059ff9d)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:14:54.194286 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: WARNING py.warnings [None req-9952b138-a743-40f1-a1cb-03901e3dd91e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:14:54.194286 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: warnings.warn(msg) May 12 17:14:54.194286 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: May 12 17:14:54.196295 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952b138-a743-40f1-a1cb-03901e3dd91e admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:14:54.272254 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-9952b138-a743-40f1-a1cb-03901e3dd91e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f2e020880543389daea8dba059ff9d'} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:14:54.272895 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-9952b138-a743-40f1-a1cb-03901e3dd91e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f2e020880543389daea8dba059ff9d'} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:14:54.273484 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-9952b138-a743-40f1-a1cb-03901e3dd91e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f2e020880543389daea8dba059ff9d'} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:14:54.280842 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-9952b138-a743-40f1-a1cb-03901e3dd91e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f2e020880543389daea8dba059ff9d'} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:14:54.290974 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-9952b138-a743-40f1-a1cb-03901e3dd91e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f2e020880543389daea8dba059ff9d'} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:14:54.314314 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 618/1255] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 12 17:14:54 2022] DELETE /identity/v3/users/b2f2e020880543389daea8dba059ff9d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:14:54.477698 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b40df-745a-4ab7-9243-663138b6637a service neutron] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:14:54.487954 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b40df-745a-4ab7-9243-663138b6637a service neutron] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:14:54.546693 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb837a3-6daa-435f-8e77-42821799397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:14:54.547564 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb837a3-6daa-435f-8e77-42821799397d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:14:54.547880 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb837a3-6daa-435f-8e77-42821799397d admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:14:54.548155 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb837a3-6daa-435f-8e77-42821799397d admin admin] PATH_INFO: `/v3/projects/13c4d42106c4481297ff29ddd393c5df` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:14:54.559280 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb837a3-6daa-435f-8e77-42821799397d admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c4d42106c4481297ff29ddd393c5df)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:14:54.560382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: WARNING py.warnings [None req-cdb837a3-6daa-435f-8e77-42821799397d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 17:14:54.560382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: warnings.warn(msg) May 12 17:14:54.560382 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: May 12 17:14:54.561605 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb837a3-6daa-435f-8e77-42821799397d admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:14:54.612377 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-cdb837a3-6daa-435f-8e77-42821799397d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c4d42106c4481297ff29ddd393c5df', 'request_id': 'req-cdb837a3-6daa-435f-8e77-42821799397d'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:14:54.617936 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-cdb837a3-6daa-435f-8e77-42821799397d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c4d42106c4481297ff29ddd393c5df', 'request_id': 'req-cdb837a3-6daa-435f-8e77-42821799397d'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:14:54.626995 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-cdb837a3-6daa-435f-8e77-42821799397d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c4d42106c4481297ff29ddd393c5df', 'request_id': 'req-cdb837a3-6daa-435f-8e77-42821799397d'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:14:54.644676 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-cdb837a3-6daa-435f-8e77-42821799397d admin admin] The token cache is being invalidate because project 13c4d42106c4481297ff29ddd393c5df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:14:54.644963 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-cdb837a3-6daa-435f-8e77-42821799397d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:14:54.645600 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-cdb837a3-6daa-435f-8e77-42821799397d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:14:54.647144 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 638/1256] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 12 17:14:54 2022] DELETE /identity/v3/projects/13c4d42106c4481297ff29ddd393c5df => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:14:54.651561 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952b138-a743-40f1-a1cb-03901e3dd91e admin admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:14:54.652976 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-9952b138-a743-40f1-a1cb-03901e3dd91e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:14:54.665961 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952b138-a743-40f1-a1cb-03901e3dd91e admin admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:14:54.720080 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1d280-a596-4444-8899-48d77088c440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:14:54.720947 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1d280-a596-4444-8899-48d77088c440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:14:54.721229 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1d280-a596-4444-8899-48d77088c440 admin admin] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:14:54.721541 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1d280-a596-4444-8899-48d77088c440 admin admin] PATH_INFO: `/v3/users/fb7aa5dfc1164aa08192399ac560a13b` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:14:54.722703 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1d280-a596-4444-8899-48d77088c440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb7aa5dfc1164aa08192399ac560a13b)` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:14:54.724923 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1d280-a596-4444-8899-48d77088c440 admin admin] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:14:54.767686 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-3ca1d280-a596-4444-8899-48d77088c440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb7aa5dfc1164aa08192399ac560a13b'} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:14:54.768223 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-3ca1d280-a596-4444-8899-48d77088c440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb7aa5dfc1164aa08192399ac560a13b'} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:14:54.768820 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-3ca1d280-a596-4444-8899-48d77088c440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb7aa5dfc1164aa08192399ac560a13b'} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:14:54.777688 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-3ca1d280-a596-4444-8899-48d77088c440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb7aa5dfc1164aa08192399ac560a13b'} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:14:54.784592 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.notifications [None req-3ca1d280-a596-4444-8899-48d77088c440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb7aa5dfc1164aa08192399ac560a13b'} {{(pid=86674) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:14:54.801885 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 619/1257] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 12 17:14:54 2022] DELETE /identity/v3/users/fb7aa5dfc1164aa08192399ac560a13b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:14:54.981588 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb837a3-6daa-435f-8e77-42821799397d admin admin] Authenticating user token {{(pid=86673) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:14:54.983030 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.fernet_utils [None req-cdb837a3-6daa-435f-8e77-42821799397d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86673) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:14:54.995326 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb837a3-6daa-435f-8e77-42821799397d admin admin] Validating token access rules against request {{(pid=86673) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:14:55.049009 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85ef20-1ab1-43f8-8dba-f11278515ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbf536e8106349f196ff7b89dc343a4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dca91e00e894d69a0b385cea4a3db66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86673) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:14:55.049862 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85ef20-1ab1-43f8-8dba-f11278515ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:14:55.050142 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85ef20-1ab1-43f8-8dba-f11278515ede admin admin] SCRIPT_NAME: `/identity` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:14:55.050414 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85ef20-1ab1-43f8-8dba-f11278515ede admin admin] PATH_INFO: `/v3/projects/6173ada980f6436db9a1af20571facb1` {{(pid=86673) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:14:55.060680 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85ef20-1ab1-43f8-8dba-f11278515ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=6173ada980f6436db9a1af20571facb1)` {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:14:55.062618 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf85ef20-1ab1-43f8-8dba-f11278515ede admin admin] RBAC: Authorization granted {{(pid=86673) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:14:55.106507 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-bf85ef20-1ab1-43f8-8dba-f11278515ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6173ada980f6436db9a1af20571facb1', 'request_id': 'req-bf85ef20-1ab1-43f8-8dba-f11278515ede'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:14:55.111606 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-bf85ef20-1ab1-43f8-8dba-f11278515ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6173ada980f6436db9a1af20571facb1', 'request_id': 'req-bf85ef20-1ab1-43f8-8dba-f11278515ede'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:14:55.118441 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-bf85ef20-1ab1-43f8-8dba-f11278515ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6173ada980f6436db9a1af20571facb1', 'request_id': 'req-bf85ef20-1ab1-43f8-8dba-f11278515ede'} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:14:55.129161 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-bf85ef20-1ab1-43f8-8dba-f11278515ede admin admin] The token cache is being invalidate because project 6173ada980f6436db9a1af20571facb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86673) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 17:14:55.129449 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-bf85ef20-1ab1-43f8-8dba-f11278515ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:14:55.130085 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: DEBUG keystone.notifications [None req-bf85ef20-1ab1-43f8-8dba-f11278515ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86673) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 17:14:55.131623 dv-osbrick-836060-4-ceph devstack@keystone.service[86673]: [pid: 86673|app: 0|req: 639/1258] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 12 17:14:54 2022] DELETE /identity/v3/projects/6173ada980f6436db9a1af20571facb1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 17:19:06.972184 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1d280-a596-4444-8899-48d77088c440 admin admin] Authenticating user token {{(pid=86674) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 17:19:06.973613 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-3ca1d280-a596-4444-8899-48d77088c440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:19:07.051622 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1d280-a596-4444-8899-48d77088c440 admin admin] Validating token access rules against request {{(pid=86674) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 17:19:07.109072 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338671e7-9d4d-4638-be0b-a80dd7228928 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c64a6e5ef494d00817bb47cd6fd2bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2ccefb3ecb0493bb0240a3853bfa5ff', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86674) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 17:19:07.109724 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338671e7-9d4d-4638-be0b-a80dd7228928 service placement] REQUEST_METHOD: `GET` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 17:19:07.110009 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338671e7-9d4d-4638-be0b-a80dd7228928 service placement] SCRIPT_NAME: `/identity` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 17:19:07.110287 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338671e7-9d4d-4638-be0b-a80dd7228928 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86674) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 17:19:07.112102 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.fernet_utils [None req-338671e7-9d4d-4638-be0b-a80dd7228928 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86674) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 17:19:07.123349 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338671e7-9d4d-4638-be0b-a80dd7228928 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 17:19:07.125027 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338671e7-9d4d-4638-be0b-a80dd7228928 service placement] RBAC: Authorization granted {{(pid=86674) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 17:19:07.134490 dv-osbrick-836060-4-ceph devstack@keystone.service[86674]: [pid: 86674|app: 0|req: 620/1259] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 12 17:19:06 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0)